2023-09-29T22:53:42.262 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-29T22:53:42.262 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi --owner scheduled_yuriw@teuthology --description rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{ubuntu_latest} tasks/crash} --archive /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519 -- /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519/orig.config.yaml 2023-09-29T22:53:42.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T22:53:42.386 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519 branch: wip-yuri4-testing-2023-09-29-0928-quincy description: rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{ubuntu_latest} tasks/crash} email: yweinste@redhat.com first_in_suite: false job_id: '7406519' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 2 size: 30 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri4-testing-2023-09-29-0928-quincy ceph: conf: client: debug client: 20 debug mgrc: 20 debug ms: 1 global: mon election default strategy: 1 mds: debug mgrc: 20 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mgr ttl cache expire seconds: 0 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug mgrc: 20 debug ms: 1 debug osd: 20 osd objectstore: filestore osd sloppy crc: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: default sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 workunit: branch: wip-yuri4-testing-2023-09-29-0928-quincy sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mgr.x - mon.a - mon.c - mds.a - mds.c - osd.0 - client.0 - - mgr.y - mgr.z - mon.b - mds.b - osd.1 - osd.2 - osd.3 - client.1 seed: 9810 sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri4-testing-2023-09-29-0928-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 targets: smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: null - ceph: log-ignorelist: - overall HEALTH_ - \(MGR_DOWN\) - \(PG_ - \(RECENT_CRASH\) - replacing it with standby - No standby daemons available wait-for-scrub: false - cephfs_test_runner: modules: - tasks.mgr.test_crash teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-29_19:38:56 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-29T22:53:42.387 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa; will attempt to use it 2023-09-29T22:53:42.387 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks 2023-09-29T22:53:42.388 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-29T22:53:42.389 INFO:teuthology.task.internal:Checking packages... 2023-09-29T22:53:42.413 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '93dce5e17918f8aca65993a7a2dc40233a47b481' 2023-09-29T22:53:42.413 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-29T22:53:42.413 INFO:teuthology.packaging:ref: None 2023-09-29T22:53:42.413 INFO:teuthology.packaging:tag: None 2023-09-29T22:53:42.413 INFO:teuthology.packaging:branch: wip-yuri4-testing-2023-09-29-0928-quincy 2023-09-29T22:53:42.414 INFO:teuthology.packaging:sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 2023-09-29T22:53:42.414 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri4-testing-2023-09-29-0928-quincy 2023-09-29T22:53:42.559 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1165-g93dce5e1-1focal 2023-09-29T22:53:42.560 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-29T22:53:42.568 INFO:teuthology.task.internal:no buildpackages task found 2023-09-29T22:53:42.568 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-29T22:53:42.596 INFO:teuthology.task.internal:Saving configuration 2023-09-29T22:53:42.616 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-29T22:53:42.627 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-29T22:53:42.653 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 22:47:28.262461', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-09-29T22:53:42.678 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 22:47:28.261044', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-09-29T22:53:42.678 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-29T22:53:42.689 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mgr.x', 'mon.a', 'mon.c', 'mds.a', 'mds.c', 'osd.0', 'client.0'] 2023-09-29T22:53:42.689 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mgr.y', 'mgr.z', 'mon.b', 'mds.b', 'osd.1', 'osd.2', 'osd.3', 'client.1'] 2023-09-29T22:53:42.690 INFO:teuthology.run_tasks:Running task console_log... 2023-09-29T22:53:42.766 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5796172040>, signals=[15]) 2023-09-29T22:53:42.766 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-29T22:53:42.773 INFO:teuthology.task.internal:Opening connections... 2023-09-29T22:53:42.773 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2023-09-29T22:53:42.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T22:53:42.824 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2023-09-29T22:53:42.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T22:53:42.873 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-29T22:53:42.882 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2023-09-29T22:53:42.906 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2023-09-29T22:53:42.907 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-09-29T22:53:42.912 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Ubuntu" 2023-09-29T22:53:42.912 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-09-29T22:53:42.912 INFO:teuthology.orchestra.run.smithi115.stdout:ID=ubuntu 2023-09-29T22:53:42.912 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE=debian 2023-09-29T22:53:42.912 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-09-29T22:53:42.912 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="20.04" 2023-09-29T22:53:42.912 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-29T22:53:42.912 INFO:teuthology.orchestra.run.smithi115.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-29T22:53:42.913 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-29T22:53:42.913 INFO:teuthology.orchestra.run.smithi115.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-29T22:53:42.913 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_CODENAME=focal 2023-09-29T22:53:42.913 INFO:teuthology.orchestra.run.smithi115.stdout:UBUNTU_CODENAME=focal 2023-09-29T22:53:42.913 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-09-29T22:53:42.936 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-09-29T22:53:42.956 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-09-29T22:53:42.957 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-09-29T22:53:43.009 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu" 2023-09-29T22:53:43.009 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-09-29T22:53:43.009 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu 2023-09-29T22:53:43.009 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian 2023-09-29T22:53:43.010 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-09-29T22:53:43.010 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="20.04" 2023-09-29T22:53:43.010 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-29T22:53:43.010 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-29T22:53:43.010 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-29T22:53:43.010 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-29T22:53:43.010 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=focal 2023-09-29T22:53:43.010 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=focal 2023-09-29T22:53:43.010 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-09-29T22:53:43.028 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-29T22:53:43.037 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-29T22:53:43.045 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-29T22:53:43.045 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2023-09-29T22:53:43.047 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2023-09-29T22:53:43.053 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-29T22:53:43.060 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-29T22:53:43.060 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2023-09-29T22:53:43.062 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2023-09-29T22:53:43.078 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-29T22:53:43.133 INFO:teuthology.run_tasks:Running task kernel... 2023-09-29T22:53:43.147 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-09-29T22:53:43.148 INFO:teuthology.task.kernel:config {'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-09-29T22:53:43.148 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-29T22:53:43.148 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-29T22:53:43.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-29T22:53:43.154 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2023-09-29T22:53:43.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-29T22:53:43.156 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-09-29T22:53:43.163 INFO:teuthology.orchestra.run.smithi156.stdout:5.4.0-124-generic 2023-09-29T22:53:43.163 INFO:teuthology.task.kernel:Running kernel on smithi156: 5.4.0-124-generic 2023-09-29T22:53:43.163 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get clean 2023-09-29T22:53:43.201 INFO:teuthology.orchestra.run.smithi115.stdout:5.4.0-124-generic 2023-09-29T22:53:43.202 INFO:teuthology.task.kernel:Running kernel on smithi115: 5.4.0-124-generic 2023-09-29T22:53:43.202 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get clean 2023-09-29T22:53:43.310 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get update 2023-09-29T22:53:43.314 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get update 2023-09-29T22:53:43.460 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-09-29T22:53:43.476 INFO:teuthology.orchestra.run.smithi156.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-09-29T22:53:43.547 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-09-29T22:53:43.569 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-09-29T22:53:43.622 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-09-29T22:53:43.627 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-09-29T22:53:43.683 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-09-29T22:53:43.864 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [885 kB] 2023-09-29T22:53:43.961 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,852 kB] 2023-09-29T22:53:44.004 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [469 kB] 2023-09-29T22:53:44.007 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-09-29T22:53:44.008 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,330 kB] 2023-09-29T22:53:44.028 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-09-29T22:53:44.029 INFO:teuthology.orchestra.run.smithi156.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.7 kB] 2023-09-29T22:53:44.029 INFO:teuthology.orchestra.run.smithi156.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [325 kB] 2023-09-29T22:53:44.032 INFO:teuthology.orchestra.run.smithi156.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-09-29T22:53:44.032 INFO:teuthology.orchestra.run.smithi156.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [748 kB] 2023-09-29T22:53:44.038 INFO:teuthology.orchestra.run.smithi156.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,117 kB] 2023-09-29T22:53:44.049 INFO:teuthology.orchestra.run.smithi156.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [267 kB] 2023-09-29T22:53:44.052 INFO:teuthology.orchestra.run.smithi156.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-09-29T22:53:44.052 INFO:teuthology.orchestra.run.smithi156.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-09-29T22:53:44.053 INFO:teuthology.orchestra.run.smithi156.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.9 kB] 2023-09-29T22:53:44.053 INFO:teuthology.orchestra.run.smithi156.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-09-29T22:53:44.053 INFO:teuthology.orchestra.run.smithi156.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-09-29T22:53:44.071 INFO:teuthology.orchestra.run.smithi156.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-09-29T22:53:44.072 INFO:teuthology.orchestra.run.smithi156.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-09-29T22:53:44.073 INFO:teuthology.orchestra.run.smithi156.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-09-29T22:53:44.073 INFO:teuthology.orchestra.run.smithi156.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-09-29T22:53:44.091 INFO:teuthology.orchestra.run.smithi156.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-09-29T22:53:44.091 INFO:teuthology.orchestra.run.smithi156.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-09-29T22:53:44.097 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,464 kB] 2023-09-29T22:53:44.186 INFO:teuthology.orchestra.run.smithi156.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,464 kB] 2023-09-29T22:53:44.233 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [885 kB] 2023-09-29T22:53:44.614 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,852 kB] 2023-09-29T22:53:44.614 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [652 kB] 2023-09-29T22:53:44.629 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [385 kB] 2023-09-29T22:53:44.638 INFO:teuthology.orchestra.run.smithi115.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-09-29T22:53:44.638 INFO:teuthology.orchestra.run.smithi115.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-09-29T22:53:44.639 INFO:teuthology.orchestra.run.smithi115.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,218 kB] 2023-09-29T22:53:44.661 INFO:teuthology.orchestra.run.smithi156.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [652 kB] 2023-09-29T22:53:44.678 INFO:teuthology.orchestra.run.smithi156.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [385 kB] 2023-09-29T22:53:44.684 INFO:teuthology.orchestra.run.smithi156.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-09-29T22:53:44.685 INFO:teuthology.orchestra.run.smithi156.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,218 kB] 2023-09-29T22:53:44.713 INFO:teuthology.orchestra.run.smithi115.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [309 kB] 2023-09-29T22:53:44.720 INFO:teuthology.orchestra.run.smithi115.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-09-29T22:53:44.720 INFO:teuthology.orchestra.run.smithi115.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [615 kB] 2023-09-29T22:53:44.734 INFO:teuthology.orchestra.run.smithi115.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [886 kB] 2023-09-29T22:53:44.760 INFO:teuthology.orchestra.run.smithi156.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-09-29T22:53:44.760 INFO:teuthology.orchestra.run.smithi156.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [309 kB] 2023-09-29T22:53:44.767 INFO:teuthology.orchestra.run.smithi156.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-09-29T22:53:44.767 INFO:teuthology.orchestra.run.smithi156.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [615 kB] 2023-09-29T22:53:44.781 INFO:teuthology.orchestra.run.smithi156.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [886 kB] 2023-09-29T22:53:44.789 INFO:teuthology.orchestra.run.smithi115.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [469 kB] 2023-09-29T22:53:44.802 INFO:teuthology.orchestra.run.smithi115.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-09-29T22:53:44.803 INFO:teuthology.orchestra.run.smithi115.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,330 kB] 2023-09-29T22:53:44.872 INFO:teuthology.orchestra.run.smithi115.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.7 kB] 2023-09-29T22:53:44.873 INFO:teuthology.orchestra.run.smithi115.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [325 kB] 2023-09-29T22:53:44.878 INFO:teuthology.orchestra.run.smithi115.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-09-29T22:53:44.917 INFO:teuthology.orchestra.run.smithi115.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [185 kB] 2023-09-29T22:53:44.964 INFO:teuthology.orchestra.run.smithi156.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [185 kB] 2023-09-29T22:53:45.042 INFO:teuthology.orchestra.run.smithi115.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,117 kB] 2023-09-29T22:53:45.333 INFO:teuthology.orchestra.run.smithi115.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-09-29T22:53:45.339 INFO:teuthology.orchestra.run.smithi115.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-09-29T22:53:45.347 INFO:teuthology.orchestra.run.smithi115.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-09-29T22:53:45.350 INFO:teuthology.orchestra.run.smithi115.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-09-29T22:53:45.353 INFO:teuthology.orchestra.run.smithi115.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-09-29T22:53:45.379 INFO:teuthology.orchestra.run.smithi156.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-09-29T22:53:45.385 INFO:teuthology.orchestra.run.smithi156.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-09-29T22:53:45.387 INFO:teuthology.orchestra.run.smithi156.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-09-29T22:53:45.395 INFO:teuthology.orchestra.run.smithi156.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-09-29T22:53:45.397 INFO:teuthology.orchestra.run.smithi156.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-09-29T22:53:45.679 INFO:teuthology.orchestra.run.smithi115.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [748 kB] 2023-09-29T22:53:45.716 INFO:teuthology.orchestra.run.smithi115.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [267 kB] 2023-09-29T22:53:45.729 INFO:teuthology.orchestra.run.smithi115.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-09-29T22:53:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.9 kB] 2023-09-29T22:53:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-09-29T22:53:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-09-29T22:53:45.733 INFO:teuthology.orchestra.run.smithi115.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-09-29T22:53:45.733 INFO:teuthology.orchestra.run.smithi115.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-09-29T22:53:45.760 INFO:teuthology.orchestra.run.smithi115.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-09-29T22:53:45.762 INFO:teuthology.orchestra.run.smithi115.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-09-29T22:53:45.926 INFO:teuthology.orchestra.run.smithi115.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-09-29T22:53:46.109 INFO:teuthology.orchestra.run.smithi115.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-09-29T22:53:46.131 INFO:teuthology.orchestra.run.smithi115.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-09-29T22:53:47.929 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 17.4 MB in 2s (6,963 kB/s) 2023-09-29T22:53:48.360 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 17.4 MB in 3s (5,641 kB/s) 2023-09-29T22:53:49.384 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-09-29T22:53:49.410 DEBUG:teuthology.orchestra.run.smithi156:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-29T22:53:49.506 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-09-29T22:53:49.706 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2023-09-29T22:53:49.707 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2023-09-29T22:53:49.821 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2023-09-29T22:53:49.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-29T22:53:49.895 INFO:teuthology.orchestra.run.smithi156.stdout:The following additional packages will be installed: 2023-09-29T22:53:49.895 INFO:teuthology.orchestra.run.smithi156.stdout: linux-generic linux-headers-5.4.0-163 linux-headers-5.4.0-163-generic 2023-09-29T22:53:49.895 INFO:teuthology.orchestra.run.smithi156.stdout: linux-headers-generic linux-image-5.4.0-163-generic 2023-09-29T22:53:49.895 INFO:teuthology.orchestra.run.smithi156.stdout: linux-modules-5.4.0-163-generic linux-modules-extra-5.4.0-163-generic 2023-09-29T22:53:49.896 INFO:teuthology.orchestra.run.smithi156.stdout:Suggested packages: 2023-09-29T22:53:49.896 INFO:teuthology.orchestra.run.smithi156.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-09-29T22:53:49.896 INFO:teuthology.orchestra.run.smithi156.stdout:Recommended packages: 2023-09-29T22:53:49.896 INFO:teuthology.orchestra.run.smithi156.stdout: thermald 2023-09-29T22:53:49.921 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2023-09-29T22:53:49.953 INFO:teuthology.orchestra.run.smithi156.stdout:The following NEW packages will be installed: 2023-09-29T22:53:49.953 INFO:teuthology.orchestra.run.smithi156.stdout: linux-headers-5.4.0-163 linux-headers-5.4.0-163-generic 2023-09-29T22:53:49.954 INFO:teuthology.orchestra.run.smithi156.stdout: linux-image-5.4.0-163-generic linux-modules-5.4.0-163-generic 2023-09-29T22:53:49.954 INFO:teuthology.orchestra.run.smithi156.stdout: linux-modules-extra-5.4.0-163-generic 2023-09-29T22:53:49.954 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages will be upgraded: 2023-09-29T22:53:49.955 INFO:teuthology.orchestra.run.smithi156.stdout: linux-generic linux-headers-generic linux-image-generic 2023-09-29T22:53:50.010 INFO:teuthology.orchestra.run.smithi156.stdout:3 upgraded, 5 newly installed, 0 to remove and 263 not upgraded. 2023-09-29T22:53:50.010 INFO:teuthology.orchestra.run.smithi156.stdout:Need to get 77.1 MB of archives. 2023-09-29T22:53:50.010 INFO:teuthology.orchestra.run.smithi156.stdout:After this operation, 380 MB of additional disk space will be used. 2023-09-29T22:53:50.010 INFO:teuthology.orchestra.run.smithi156.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-163-generic amd64 5.4.0-163.180 [15.0 MB] 2023-09-29T22:53:50.121 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2023-09-29T22:53:50.122 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2023-09-29T22:53:50.305 INFO:teuthology.orchestra.run.smithi115.stdout:The following additional packages will be installed: 2023-09-29T22:53:50.305 INFO:teuthology.orchestra.run.smithi115.stdout: linux-generic linux-headers-5.4.0-163 linux-headers-5.4.0-163-generic 2023-09-29T22:53:50.305 INFO:teuthology.orchestra.run.smithi115.stdout: linux-headers-generic linux-image-5.4.0-163-generic 2023-09-29T22:53:50.305 INFO:teuthology.orchestra.run.smithi115.stdout: linux-modules-5.4.0-163-generic linux-modules-extra-5.4.0-163-generic 2023-09-29T22:53:50.306 INFO:teuthology.orchestra.run.smithi115.stdout:Suggested packages: 2023-09-29T22:53:50.306 INFO:teuthology.orchestra.run.smithi115.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-09-29T22:53:50.306 INFO:teuthology.orchestra.run.smithi115.stdout:Recommended packages: 2023-09-29T22:53:50.306 INFO:teuthology.orchestra.run.smithi115.stdout: thermald 2023-09-29T22:53:50.308 INFO:teuthology.orchestra.run.smithi156.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-163-generic amd64 5.4.0-163.180 [10.5 MB] 2023-09-29T22:53:50.356 INFO:teuthology.orchestra.run.smithi115.stdout:The following NEW packages will be installed: 2023-09-29T22:53:50.356 INFO:teuthology.orchestra.run.smithi115.stdout: linux-headers-5.4.0-163 linux-headers-5.4.0-163-generic 2023-09-29T22:53:50.356 INFO:teuthology.orchestra.run.smithi115.stdout: linux-image-5.4.0-163-generic linux-modules-5.4.0-163-generic 2023-09-29T22:53:50.356 INFO:teuthology.orchestra.run.smithi115.stdout: linux-modules-extra-5.4.0-163-generic 2023-09-29T22:53:50.357 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages will be upgraded: 2023-09-29T22:53:50.357 INFO:teuthology.orchestra.run.smithi115.stdout: linux-generic linux-headers-generic linux-image-generic 2023-09-29T22:53:50.400 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-163-generic amd64 5.4.0-163.180 [39.2 MB] 2023-09-29T22:53:50.410 INFO:teuthology.orchestra.run.smithi115.stdout:3 upgraded, 5 newly installed, 0 to remove and 263 not upgraded. 2023-09-29T22:53:50.411 INFO:teuthology.orchestra.run.smithi115.stdout:Need to get 77.1 MB of archives. 2023-09-29T22:53:50.411 INFO:teuthology.orchestra.run.smithi115.stdout:After this operation, 380 MB of additional disk space will be used. 2023-09-29T22:53:50.411 INFO:teuthology.orchestra.run.smithi115.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-163-generic amd64 5.4.0-163.180 [15.0 MB] 2023-09-29T22:53:50.737 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-163-generic amd64 5.4.0-163.180 [10.5 MB] 2023-09-29T22:53:50.834 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-163-generic amd64 5.4.0-163.180 [39.2 MB] 2023-09-29T22:53:50.860 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.163.160 [1,904 B] 2023-09-29T22:53:50.860 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.163.160 [2,604 B] 2023-09-29T22:53:50.861 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-163 all 5.4.0-163.180 [11.0 MB] 2023-09-29T22:53:50.952 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-163-generic amd64 5.4.0-163.180 [1,358 kB] 2023-09-29T22:53:50.962 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.163.160 [2,468 B] 2023-09-29T22:53:51.363 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.163.160 [1,904 B] 2023-09-29T22:53:51.363 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.163.160 [2,604 B] 2023-09-29T22:53:51.364 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-163 all 5.4.0-163.180 [11.0 MB] 2023-09-29T22:53:51.459 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-163-generic amd64 5.4.0-163.180 [1,358 kB] 2023-09-29T22:53:51.469 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.163.160 [2,468 B] 2023-09-29T22:53:51.644 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 77.1 MB in 1s (77.0 MB/s) 2023-09-29T22:53:51.836 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-modules-5.4.0-163-generic. 2023-09-29T22:53:52.154 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 77.1 MB in 1s (69.7 MB/s) 2023-09-29T22:53:52.349 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-modules-5.4.0-163-generic. 2023-09-29T22:53:53.572 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-09-29T22:53:53.578 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../0-linux-modules-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-29T22:53:53.683 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-modules-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:53:54.087 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-09-29T22:53:54.091 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../0-linux-modules-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-29T22:53:54.238 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-modules-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:53:55.633 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-image-5.4.0-163-generic. 2023-09-29T22:53:55.650 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../1-linux-image-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-29T22:53:55.737 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-image-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:53:56.221 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-image-5.4.0-163-generic. 2023-09-29T22:53:56.236 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../1-linux-image-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-29T22:53:56.343 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-image-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:53:56.828 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-163-generic. 2023-09-29T22:53:56.841 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-29T22:53:56.877 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-modules-extra-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:53:57.440 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-163-generic. 2023-09-29T22:53:57.453 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-29T22:53:57.490 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-modules-extra-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:54:01.822 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../3-linux-generic_5.4.0.163.160_amd64.deb ... 2023-09-29T22:54:01.948 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-generic (5.4.0.163.160) over (5.4.0.124.125) ... 2023-09-29T22:54:02.292 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.163.160_amd64.deb ... 2023-09-29T22:54:02.419 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-image-generic (5.4.0.163.160) over (5.4.0.124.125) ... 2023-09-29T22:54:02.550 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../3-linux-generic_5.4.0.163.160_amd64.deb ... 2023-09-29T22:54:02.701 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-generic (5.4.0.163.160) over (5.4.0.124.125) ... 2023-09-29T22:54:02.771 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-headers-5.4.0-163. 2023-09-29T22:54:02.788 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../5-linux-headers-5.4.0-163_5.4.0-163.180_all.deb ... 2023-09-29T22:54:02.829 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-headers-5.4.0-163 (5.4.0-163.180) ... 2023-09-29T22:54:03.028 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.163.160_amd64.deb ... 2023-09-29T22:54:03.171 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-image-generic (5.4.0.163.160) over (5.4.0.124.125) ... 2023-09-29T22:54:03.524 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-headers-5.4.0-163. 2023-09-29T22:54:03.538 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../5-linux-headers-5.4.0-163_5.4.0-163.180_all.deb ... 2023-09-29T22:54:03.582 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-5.4.0-163 (5.4.0-163.180) ... 2023-09-29T22:54:08.939 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-headers-5.4.0-163-generic. 2023-09-29T22:54:08.962 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../6-linux-headers-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-29T22:54:09.006 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-headers-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:54:09.047 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-headers-5.4.0-163-generic. 2023-09-29T22:54:09.068 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../6-linux-headers-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-29T22:54:09.105 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:54:11.770 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.163.160_amd64.deb ... 2023-09-29T22:54:11.826 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.163.160_amd64.deb ... 2023-09-29T22:54:11.907 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-headers-generic (5.4.0.163.160) over (5.4.0.124.125) ... 2023-09-29T22:54:11.931 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-generic (5.4.0.163.160) over (5.4.0.124.125) ... 2023-09-29T22:54:12.269 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-modules-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:54:12.318 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-modules-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:54:13.504 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-headers-5.4.0-163 (5.4.0-163.180) ... 2023-09-29T22:54:13.545 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-5.4.0-163 (5.4.0-163.180) ... 2023-09-29T22:54:13.631 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-image-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:54:13.679 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-image-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:54:14.790 INFO:teuthology.orchestra.run.smithi156.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-163-generic 2023-09-29T22:54:14.790 INFO:teuthology.orchestra.run.smithi156.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-163-generic 2023-09-29T22:54:14.833 INFO:teuthology.orchestra.run.smithi115.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-163-generic 2023-09-29T22:54:14.833 INFO:teuthology.orchestra.run.smithi115.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-163-generic 2023-09-29T22:54:14.941 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-headers-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:54:14.990 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:54:15.067 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-modules-extra-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:54:15.116 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-modules-extra-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:54:16.243 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-image-generic (5.4.0.163.160) ... 2023-09-29T22:54:16.292 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-image-generic (5.4.0.163.160) ... 2023-09-29T22:54:16.369 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-headers-generic (5.4.0.163.160) ... 2023-09-29T22:54:16.435 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-generic (5.4.0.163.160) ... 2023-09-29T22:54:16.495 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-generic (5.4.0.163.160) ... 2023-09-29T22:54:16.561 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-generic (5.4.0.163.160) ... 2023-09-29T22:54:16.638 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for linux-image-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:54:16.687 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for linux-image-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-29T22:54:16.715 INFO:teuthology.orchestra.run.smithi156.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-09-29T22:54:16.715 INFO:teuthology.orchestra.run.smithi156.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-163-generic 2023-09-29T22:54:16.784 INFO:teuthology.orchestra.run.smithi115.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-09-29T22:54:16.784 INFO:teuthology.orchestra.run.smithi115.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-163-generic 2023-09-29T22:54:39.202 INFO:teuthology.orchestra.run.smithi115.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-09-29T22:54:39.202 INFO:teuthology.orchestra.run.smithi115.stdout:Sourcing file `/etc/default/grub' 2023-09-29T22:54:39.218 INFO:teuthology.orchestra.run.smithi115.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-29T22:54:39.244 INFO:teuthology.orchestra.run.smithi115.stdout:Generating grub configuration file ... 2023-09-29T22:54:39.500 INFO:teuthology.orchestra.run.smithi156.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-09-29T22:54:39.501 INFO:teuthology.orchestra.run.smithi156.stdout:Sourcing file `/etc/default/grub' 2023-09-29T22:54:39.513 INFO:teuthology.orchestra.run.smithi156.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-29T22:54:39.533 INFO:teuthology.orchestra.run.smithi156.stdout:Generating grub configuration file ... 2023-09-29T22:54:39.541 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.4.0-163-generic 2023-09-29T22:54:39.559 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.4.0-163-generic 2023-09-29T22:54:39.856 INFO:teuthology.orchestra.run.smithi156.stdout:Found linux image: /boot/vmlinuz-5.4.0-163-generic 2023-09-29T22:54:39.878 INFO:teuthology.orchestra.run.smithi156.stdout:Found initrd image: /boot/initrd.img-5.4.0-163-generic 2023-09-29T22:54:39.969 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-09-29T22:54:39.980 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-09-29T22:54:40.273 INFO:teuthology.orchestra.run.smithi156.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-09-29T22:54:40.285 INFO:teuthology.orchestra.run.smithi156.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-09-29T22:54:42.053 INFO:teuthology.orchestra.run.smithi156.stdout:done 2023-09-29T22:54:42.496 DEBUG:teuthology.orchestra.run.smithi156:> dpkg -s linux-image-generic 2023-09-29T22:54:42.550 INFO:teuthology.orchestra.run.smithi156.stdout:Package: linux-image-generic 2023-09-29T22:54:42.550 INFO:teuthology.orchestra.run.smithi156.stdout:Status: install ok installed 2023-09-29T22:54:42.550 INFO:teuthology.orchestra.run.smithi156.stdout:Priority: optional 2023-09-29T22:54:42.550 INFO:teuthology.orchestra.run.smithi156.stdout:Section: kernel 2023-09-29T22:54:42.550 INFO:teuthology.orchestra.run.smithi156.stdout:Installed-Size: 20 2023-09-29T22:54:42.551 INFO:teuthology.orchestra.run.smithi156.stdout:Maintainer: Ubuntu Kernel Team 2023-09-29T22:54:42.551 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: amd64 2023-09-29T22:54:42.551 INFO:teuthology.orchestra.run.smithi156.stdout:Source: linux-meta 2023-09-29T22:54:42.551 INFO:teuthology.orchestra.run.smithi156.stdout:Version: 5.4.0.163.160 2023-09-29T22:54:42.551 INFO:teuthology.orchestra.run.smithi156.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-09-29T22:54:42.551 INFO:teuthology.orchestra.run.smithi156.stdout:Depends: linux-image-5.4.0-163-generic, linux-modules-extra-5.4.0-163-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-29T22:54:42.551 INFO:teuthology.orchestra.run.smithi156.stdout:Recommends: thermald 2023-09-29T22:54:42.552 INFO:teuthology.orchestra.run.smithi156.stdout:Description: Generic Linux kernel image 2023-09-29T22:54:42.552 INFO:teuthology.orchestra.run.smithi156.stdout: This package will always depend on the latest generic kernel image 2023-09-29T22:54:42.552 INFO:teuthology.orchestra.run.smithi156.stdout: available. 2023-09-29T22:54:42.552 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-163-generic 2023-09-29T22:54:42.552 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-29T22:54:42.552 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-29T22:54:42.552 INFO:teuthology.task.kernel:Installing distro kernel on mgr.y... 2023-09-29T22:54:42.553 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi156.front.sepia.ceph.com, path=None, version=distro) 2023-09-29T22:54:42.553 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get clean 2023-09-29T22:54:42.638 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get update 2023-09-29T22:54:42.675 INFO:teuthology.orchestra.run.smithi115.stdout:done 2023-09-29T22:54:42.908 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-09-29T22:54:42.908 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-09-29T22:54:42.978 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-09-29T22:54:43.069 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-09-29T22:54:43.132 DEBUG:teuthology.orchestra.run.smithi115:> dpkg -s linux-image-generic 2023-09-29T22:54:43.178 INFO:teuthology.orchestra.run.smithi115.stdout:Package: linux-image-generic 2023-09-29T22:54:43.178 INFO:teuthology.orchestra.run.smithi115.stdout:Status: install ok installed 2023-09-29T22:54:43.178 INFO:teuthology.orchestra.run.smithi115.stdout:Priority: optional 2023-09-29T22:54:43.178 INFO:teuthology.orchestra.run.smithi115.stdout:Section: kernel 2023-09-29T22:54:43.178 INFO:teuthology.orchestra.run.smithi115.stdout:Installed-Size: 20 2023-09-29T22:54:43.178 INFO:teuthology.orchestra.run.smithi115.stdout:Maintainer: Ubuntu Kernel Team 2023-09-29T22:54:43.179 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: amd64 2023-09-29T22:54:43.179 INFO:teuthology.orchestra.run.smithi115.stdout:Source: linux-meta 2023-09-29T22:54:43.179 INFO:teuthology.orchestra.run.smithi115.stdout:Version: 5.4.0.163.160 2023-09-29T22:54:43.179 INFO:teuthology.orchestra.run.smithi115.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-09-29T22:54:43.179 INFO:teuthology.orchestra.run.smithi115.stdout:Depends: linux-image-5.4.0-163-generic, linux-modules-extra-5.4.0-163-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-29T22:54:43.179 INFO:teuthology.orchestra.run.smithi115.stdout:Recommends: thermald 2023-09-29T22:54:43.179 INFO:teuthology.orchestra.run.smithi115.stdout:Description: Generic Linux kernel image 2023-09-29T22:54:43.179 INFO:teuthology.orchestra.run.smithi115.stdout: This package will always depend on the latest generic kernel image 2023-09-29T22:54:43.179 INFO:teuthology.orchestra.run.smithi115.stdout: available. 2023-09-29T22:54:43.179 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-163-generic 2023-09-29T22:54:43.180 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-29T22:54:43.180 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-29T22:54:43.180 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2023-09-29T22:54:43.180 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=None, version=distro) 2023-09-29T22:54:43.180 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get clean 2023-09-29T22:54:43.314 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get update 2023-09-29T22:54:43.441 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-09-29T22:54:43.441 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-09-29T22:54:43.446 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-09-29T22:54:43.463 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-09-29T22:54:44.646 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-09-29T22:54:44.670 DEBUG:teuthology.orchestra.run.smithi156:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-29T22:54:44.739 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-09-29T22:54:44.940 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2023-09-29T22:54:44.940 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2023-09-29T22:54:45.161 INFO:teuthology.orchestra.run.smithi156.stdout:linux-image-generic is already the newest version (5.4.0.163.160). 2023-09-29T22:54:45.161 INFO:teuthology.orchestra.run.smithi156.stdout:0 upgraded, 0 newly installed, 0 to remove and 263 not upgraded. 2023-09-29T22:54:45.163 DEBUG:teuthology.orchestra.run.smithi156:> dpkg -s linux-image-generic 2023-09-29T22:54:45.165 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2023-09-29T22:54:45.183 INFO:teuthology.orchestra.run.smithi156.stdout:Package: linux-image-generic 2023-09-29T22:54:45.184 INFO:teuthology.orchestra.run.smithi156.stdout:Status: install ok installed 2023-09-29T22:54:45.184 INFO:teuthology.orchestra.run.smithi156.stdout:Priority: optional 2023-09-29T22:54:45.184 INFO:teuthology.orchestra.run.smithi156.stdout:Section: kernel 2023-09-29T22:54:45.184 INFO:teuthology.orchestra.run.smithi156.stdout:Installed-Size: 20 2023-09-29T22:54:45.184 INFO:teuthology.orchestra.run.smithi156.stdout:Maintainer: Ubuntu Kernel Team 2023-09-29T22:54:45.184 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: amd64 2023-09-29T22:54:45.184 INFO:teuthology.orchestra.run.smithi156.stdout:Source: linux-meta 2023-09-29T22:54:45.184 INFO:teuthology.orchestra.run.smithi156.stdout:Version: 5.4.0.163.160 2023-09-29T22:54:45.184 INFO:teuthology.orchestra.run.smithi156.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-09-29T22:54:45.184 INFO:teuthology.orchestra.run.smithi156.stdout:Depends: linux-image-5.4.0-163-generic, linux-modules-extra-5.4.0-163-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-29T22:54:45.184 INFO:teuthology.orchestra.run.smithi156.stdout:Recommends: thermald 2023-09-29T22:54:45.185 INFO:teuthology.orchestra.run.smithi156.stdout:Description: Generic Linux kernel image 2023-09-29T22:54:45.185 INFO:teuthology.orchestra.run.smithi156.stdout: This package will always depend on the latest generic kernel image 2023-09-29T22:54:45.185 INFO:teuthology.orchestra.run.smithi156.stdout: available. 2023-09-29T22:54:45.185 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-09-29T22:54:45.190 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-29T22:54:45.234 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.WTShEt1Cst 2023-09-29T22:54:45.234 DEBUG:teuthology.orchestra.run.smithi156:> sudo cp /boot/grub/grub.cfg /tmp/tmp.WTShEt1Cst 2023-09-29T22:54:45.248 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.WTShEt1Cst 2023-09-29T22:54:45.259 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2023-09-29T22:54:45.297 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.WTShEt1Cst is 9KB 2023-09-29T22:54:45.310 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.WTShEt1Cst 2023-09-29T22:54:45.317 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-09-29T22:54:45.374 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T22:54:45.375 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-09-29T22:54:45.375 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-09-29T22:54:45.416 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-163-generic 2023-09-29T22:54:45.416 DEBUG:teuthology.orchestra.run.smithi156:> sudo update-grub 2023-09-29T22:54:45.441 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2023-09-29T22:54:45.442 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2023-09-29T22:54:45.642 INFO:teuthology.orchestra.run.smithi115.stdout:linux-image-generic is already the newest version (5.4.0.163.160). 2023-09-29T22:54:45.642 INFO:teuthology.orchestra.run.smithi115.stdout:0 upgraded, 0 newly installed, 0 to remove and 263 not upgraded. 2023-09-29T22:54:45.644 DEBUG:teuthology.orchestra.run.smithi115:> dpkg -s linux-image-generic 2023-09-29T22:54:45.666 INFO:teuthology.orchestra.run.smithi115.stdout:Package: linux-image-generic 2023-09-29T22:54:45.667 INFO:teuthology.orchestra.run.smithi115.stdout:Status: install ok installed 2023-09-29T22:54:45.667 INFO:teuthology.orchestra.run.smithi115.stdout:Priority: optional 2023-09-29T22:54:45.667 INFO:teuthology.orchestra.run.smithi115.stdout:Section: kernel 2023-09-29T22:54:45.667 INFO:teuthology.orchestra.run.smithi115.stdout:Installed-Size: 20 2023-09-29T22:54:45.667 INFO:teuthology.orchestra.run.smithi115.stdout:Maintainer: Ubuntu Kernel Team 2023-09-29T22:54:45.667 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: amd64 2023-09-29T22:54:45.667 INFO:teuthology.orchestra.run.smithi115.stdout:Source: linux-meta 2023-09-29T22:54:45.667 INFO:teuthology.orchestra.run.smithi115.stdout:Version: 5.4.0.163.160 2023-09-29T22:54:45.667 INFO:teuthology.orchestra.run.smithi115.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-09-29T22:54:45.668 INFO:teuthology.orchestra.run.smithi115.stdout:Depends: linux-image-5.4.0-163-generic, linux-modules-extra-5.4.0-163-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-29T22:54:45.668 INFO:teuthology.orchestra.run.smithi115.stdout:Recommends: thermald 2023-09-29T22:54:45.668 INFO:teuthology.orchestra.run.smithi115.stdout:Description: Generic Linux kernel image 2023-09-29T22:54:45.668 INFO:teuthology.orchestra.run.smithi115.stdout: This package will always depend on the latest generic kernel image 2023-09-29T22:54:45.668 INFO:teuthology.orchestra.run.smithi115.stdout: available. 2023-09-29T22:54:45.668 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2023-09-29T22:54:45.674 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.72O86fSnOx 2023-09-29T22:54:45.675 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub/grub.cfg /tmp/tmp.72O86fSnOx 2023-09-29T22:54:45.731 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.72O86fSnOx 2023-09-29T22:54:45.771 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.72O86fSnOx is 9KB 2023-09-29T22:54:45.785 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.72O86fSnOx 2023-09-29T22:54:45.791 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-09-29T22:54:45.846 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T22:54:45.846 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-09-29T22:54:45.846 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-09-29T22:54:45.877 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-163-generic 2023-09-29T22:54:45.877 DEBUG:teuthology.orchestra.run.smithi115:> sudo update-grub 2023-09-29T22:54:46.707 INFO:teuthology.orchestra.run.smithi156.stderr:Sourcing file `/etc/default/grub' 2023-09-29T22:54:46.718 INFO:teuthology.orchestra.run.smithi156.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-29T22:54:46.739 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2023-09-29T22:54:47.027 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-5.4.0-163-generic 2023-09-29T22:54:47.039 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initrd.img-5.4.0-163-generic 2023-09-29T22:54:47.237 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub' 2023-09-29T22:54:47.241 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-29T22:54:47.255 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2023-09-29T22:54:47.390 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-09-29T22:54:47.402 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-09-29T22:54:47.525 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.4.0-163-generic 2023-09-29T22:54:47.537 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.4.0-163-generic 2023-09-29T22:54:47.910 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-09-29T22:54:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-09-29T22:54:48.140 INFO:teuthology.orchestra.run.smithi156.stderr:done 2023-09-29T22:54:48.142 DEBUG:teuthology.orchestra.run.smithi156:> sudo shutdown -r now 2023-09-29T22:54:49.608 INFO:teuthology.orchestra.run.smithi115.stderr:done 2023-09-29T22:54:49.610 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2023-09-29T22:55:18.170 INFO:teuthology.task.kernel:Checking client mgr.y for new kernel version... 2023-09-29T22:55:18.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-29T22:55:18.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T22:55:19.614 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2023-09-29T22:55:19.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-09-29T22:55:19.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T22:55:36.570 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-29T22:55:38.106 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-09-29T22:55:45.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-29T22:55:45.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T22:55:47.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-09-29T22:55:47.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T22:55:48.634 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-29T22:55:50.174 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-09-29T22:56:00.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-29T22:56:00.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T22:56:02.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-09-29T22:56:02.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T22:56:19.066 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-29T22:56:20.606 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-09-29T22:56:34.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-29T22:56:34.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T22:56:34.528 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-09-29T22:56:35.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-29T22:56:35.398 INFO:teuthology.task.kernel:Checking kernel version of mgr.y, want "5.4.0-163-generic"... 2023-09-29T22:56:35.398 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-09-29T22:56:35.405 INFO:teuthology.orchestra.run.smithi156.stdout:5.4.0-163-generic 2023-09-29T22:56:35.405 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-163-generic vs 5.4.0-163-generic 2023-09-29T22:56:35.405 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-29T22:56:35.405 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-09-29T22:56:35.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-09-29T22:56:35.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T22:56:35.955 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-09-29T22:56:36.406 INFO:teuthology.task.kernel:Enabling kdb on mgr.y... 2023-09-29T22:56:36.406 DEBUG:teuthology.orchestra.run.smithi156:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-29T22:56:36.571 INFO:teuthology.orchestra.run.smithi156.stdout:ttyS1 2023-09-29T22:56:36.598 DEBUG:teuthology.parallel:result is None 2023-09-29T22:56:37.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-09-29T22:56:37.210 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.4.0-163-generic"... 2023-09-29T22:56:37.210 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2023-09-29T22:56:37.260 INFO:teuthology.orchestra.run.smithi115.stdout:5.4.0-163-generic 2023-09-29T22:56:37.261 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-163-generic vs 5.4.0-163-generic 2023-09-29T22:56:37.261 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-29T22:56:37.261 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-09-29T22:56:38.262 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2023-09-29T22:56:38.263 DEBUG:teuthology.orchestra.run.smithi115:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-29T22:56:38.357 INFO:teuthology.orchestra.run.smithi115.stdout:ttyS1 2023-09-29T22:56:38.395 DEBUG:teuthology.parallel:result is None 2023-09-29T22:56:38.395 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-29T22:56:38.403 INFO:teuthology.task.internal:Creating test directory... 2023-09-29T22:56:38.403 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-29T22:56:38.406 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-29T22:56:38.413 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-29T22:56:38.431 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-29T22:56:38.445 INFO:teuthology.task.internal:Creating archive directory... 2023-09-29T22:56:38.445 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-29T22:56:38.454 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-29T22:56:38.476 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-29T22:56:38.486 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-29T22:56:38.486 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-29T22:56:38.489 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-29T22:56:38.513 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-29T22:56:38.524 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-29T22:56:38.543 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-29T22:56:38.554 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-29T22:56:38.556 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-29T22:56:38.564 INFO:teuthology.task.internal:Configuring sudo... 2023-09-29T22:56:38.564 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-29T22:56:38.566 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-29T22:56:38.583 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-29T22:56:38.595 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-29T22:56:38.595 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-29T22:56:38.622 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-29T22:56:38.630 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-29T22:56:38.637 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-29T22:56:38.644 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T22:56:38.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-29T22:56:38.668 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-29T22:56:38.678 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-29T22:56:38.685 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T22:56:38.685 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-29T22:56:38.755 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2023-09-29T22:56:38.757 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2023-09-29T22:56:38.808 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-29T22:56:38.816 INFO:teuthology.task.internal:Starting timer... 2023-09-29T22:56:38.816 INFO:teuthology.run_tasks:Running task pcp... 2023-09-29T22:56:38.827 INFO:teuthology.run_tasks:Running task selinux... 2023-09-29T22:56:38.838 DEBUG:teuthology.task.selinux:Excluding smithi115: OS 'ubuntu' does not support SELinux 2023-09-29T22:56:38.838 DEBUG:teuthology.task.selinux:Excluding smithi156: OS 'ubuntu' does not support SELinux 2023-09-29T22:56:38.838 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-29T22:56:38.838 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-09-29T22:56:38.838 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-29T22:56:38.838 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-29T22:56:38.849 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-09-29T22:56:38.849 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-29T22:56:38.866 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-29T22:56:38.868 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi115.front.sepia.ceph.com,smithi156.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-29T23:02:24.993 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi115.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com')] 2023-09-29T23:02:24.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-09-29T23:02:24.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:02:25.046 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-09-29T23:02:25.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-09-29T23:02:25.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-29T23:02:25.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:02:25.213 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-09-29T23:02:25.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-29T23:02:25.336 INFO:teuthology.run_tasks:Running task clock... 2023-09-29T23:02:25.346 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-29T23:02:25.346 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-29T23:02:25.346 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-29T23:02:25.349 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-29T23:02:25.349 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-29T23:02:25.383 INFO:teuthology.orchestra.run.smithi156.stdout:29 Sep 23:02:25 ntpd[22699]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-09-29T23:02:25.383 INFO:teuthology.orchestra.run.smithi156.stdout:29 Sep 23:02:25 ntpd[22699]: Command line: ntpd -gq 2023-09-29T23:02:25.383 INFO:teuthology.orchestra.run.smithi115.stdout:29 Sep 23:02:25 ntpd[22709]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-09-29T23:02:25.384 INFO:teuthology.orchestra.run.smithi115.stdout:29 Sep 23:02:25 ntpd[22709]: Command line: ntpd -gq 2023-09-29T23:02:25.384 INFO:teuthology.orchestra.run.smithi156.stdout:29 Sep 23:02:25 ntpd[22699]: proto: precision = 0.093 usec (-23) 2023-09-29T23:02:25.384 INFO:teuthology.orchestra.run.smithi115.stdout:29 Sep 23:02:25 ntpd[22709]: proto: precision = 0.078 usec (-24) 2023-09-29T23:02:25.385 INFO:teuthology.orchestra.run.smithi156.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-29T23:02:25.385 INFO:teuthology.orchestra.run.smithi115.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-29T23:02:25.385 INFO:teuthology.orchestra.run.smithi156.stdout:29 Sep 23:02:25 ntpd[22699]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-29T23:02:25.386 INFO:teuthology.orchestra.run.smithi115.stdout:29 Sep 23:02:25 ntpd[22709]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-29T23:02:25.386 INFO:teuthology.orchestra.run.smithi156.stderr:restrict ::: KOD does nothing without LIMITED. 2023-09-29T23:02:25.386 INFO:teuthology.orchestra.run.smithi115.stderr:restrict ::: KOD does nothing without LIMITED. 2023-09-29T23:02:25.388 INFO:teuthology.orchestra.run.smithi156.stdout:29 Sep 23:02:25 ntpd[22699]: restrict ::: KOD does nothing without LIMITED. 2023-09-29T23:02:25.388 INFO:teuthology.orchestra.run.smithi156.stdout:29 Sep 23:02:25 ntpd[22699]: Listen and drop on 0 v6wildcard [::]:123 2023-09-29T23:02:25.388 INFO:teuthology.orchestra.run.smithi156.stdout:29 Sep 23:02:25 ntpd[22699]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-09-29T23:02:25.389 INFO:teuthology.orchestra.run.smithi156.stdout:29 Sep 23:02:25 ntpd[22699]: Listen normally on 2 lo 127.0.0.1:123 2023-09-29T23:02:25.389 INFO:teuthology.orchestra.run.smithi156.stdout:29 Sep 23:02:25 ntpd[22699]: Listen normally on 3 enp3s0f1 172.21.15.156:123 2023-09-29T23:02:25.389 INFO:teuthology.orchestra.run.smithi156.stdout:29 Sep 23:02:25 ntpd[22699]: Listen normally on 4 lo [::1]:123 2023-09-29T23:02:25.389 INFO:teuthology.orchestra.run.smithi156.stdout:29 Sep 23:02:25 ntpd[22699]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6dfd%5]:123 2023-09-29T23:02:25.389 INFO:teuthology.orchestra.run.smithi156.stdout:29 Sep 23:02:25 ntpd[22699]: Listening on routing socket on fd #22 for interface updates 2023-09-29T23:02:25.389 INFO:teuthology.orchestra.run.smithi115.stdout:29 Sep 23:02:25 ntpd[22709]: restrict ::: KOD does nothing without LIMITED. 2023-09-29T23:02:25.390 INFO:teuthology.orchestra.run.smithi115.stdout:29 Sep 23:02:25 ntpd[22709]: Listen and drop on 0 v6wildcard [::]:123 2023-09-29T23:02:25.390 INFO:teuthology.orchestra.run.smithi115.stdout:29 Sep 23:02:25 ntpd[22709]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-09-29T23:02:25.390 INFO:teuthology.orchestra.run.smithi115.stdout:29 Sep 23:02:25 ntpd[22709]: Listen normally on 2 lo 127.0.0.1:123 2023-09-29T23:02:25.390 INFO:teuthology.orchestra.run.smithi115.stdout:29 Sep 23:02:25 ntpd[22709]: Listen normally on 3 enp3s0f1 172.21.15.115:123 2023-09-29T23:02:25.390 INFO:teuthology.orchestra.run.smithi115.stdout:29 Sep 23:02:25 ntpd[22709]: Listen normally on 4 lo [::1]:123 2023-09-29T23:02:25.390 INFO:teuthology.orchestra.run.smithi115.stdout:29 Sep 23:02:25 ntpd[22709]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce8f%5]:123 2023-09-29T23:02:25.390 INFO:teuthology.orchestra.run.smithi115.stdout:29 Sep 23:02:25 ntpd[22709]: Listening on routing socket on fd #22 for interface updates 2023-09-29T23:02:26.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:26 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:26.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:26 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:26.385 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:26 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:26.385 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:26 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:26.385 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:26 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:26.385 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:26 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:26.385 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:26 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:26.385 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:26 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:26.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:26 ntpd[22709]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:26.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:26 ntpd[22709]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:27.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:27 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:27.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:27 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:27.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:27 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:27.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:27 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:27.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:27 ntpd[22699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:27.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:27 ntpd[22699]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:27.385 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:27 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:27.385 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:27 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:27.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:27 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:27.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:27 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:27.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:27 ntpd[22709]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:27.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:27 ntpd[22709]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:28.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:28 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:28.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:28 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:28.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:28 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:28.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:28 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:28.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:28 ntpd[22699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:28.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:28 ntpd[22699]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:28.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:28 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:28.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:28 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:28.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:28 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:28.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:28 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:28.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:28 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:28.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:28 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:28.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:28 ntpd[22709]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:28.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:28 ntpd[22709]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:28.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:28 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:28.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:28 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:28.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:28 ntpd[22709]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:28.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:28 ntpd[22709]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:29.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:29 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:29.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:29 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:29.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:29 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:29.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:29 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:29.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:29 ntpd[22699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:29.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:29 ntpd[22699]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:29.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:29 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:29.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:29 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:29.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:29 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:29.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:29 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:29.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:29 ntpd[22709]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:29.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:29 ntpd[22709]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:30 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:30 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:30 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:30.386 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:30 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:30.387 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:30 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:30.387 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:30 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:30.387 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:30 ntpd[22699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:30.387 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:30 ntpd[22699]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:30.387 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:30 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:30.388 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:30 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:30.388 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:30 ntpd[22699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:30.388 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:30 ntpd[22699]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:30.390 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:30 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:30.391 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:30 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:30.391 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:30 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:30.391 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:30 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:30.391 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:30 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:30.391 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:30 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:30.391 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:30 ntpd[22709]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:30.391 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:30 ntpd[22709]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:30.392 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:30 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:30.392 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:30 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:30.392 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:30 ntpd[22709]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:30.392 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:30 ntpd[22709]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:31.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:31 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:31.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:31 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:31.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:31 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:31.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:31 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:31.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:31 ntpd[22699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:31.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:31 ntpd[22699]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:31.385 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:31 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:31.385 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:31 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:31.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:31 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:31.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:31 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:31.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:31 ntpd[22709]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:31.386 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:31 ntpd[22709]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:32.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:32 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:32.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:32 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:32.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:32 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:32.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:32 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:32.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:32 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:32.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:32 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:32.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:32 ntpd[22699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:32.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:32 ntpd[22699]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:32.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:32 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:32.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:32 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:32.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:32 ntpd[22699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:32.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:32 ntpd[22699]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:32.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:32.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:32.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:32.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:32.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:32.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:32.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:32.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:32.387 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:32.388 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:32.388 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:32.388 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:32.388 INFO:teuthology.orchestra.run.smithi115.stdout:29 Sep 23:02:32 ntpd[22709]: ntpd: time slew +0.001637 s 2023-09-29T23:02:32.388 INFO:teuthology.orchestra.run.smithi115.stdout:ntpd: time slew +0.001637s 2023-09-29T23:02:32.388 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-09-29T23:02:32.389 INFO:teuthology.orchestra.run.smithi115.stderr:29 Sep 23:02:32 ntpd[22709]: can't open /var/log/ntpstats/loopstats.20230929: Permission denied 2023-09-29T23:02:32.457 INFO:teuthology.orchestra.run.smithi115.stdout: remote refid st t when poll reach delay offset jitter 2023-09-29T23:02:32.457 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================== 2023-09-29T23:02:32.457 INFO:teuthology.orchestra.run.smithi115.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-29T23:02:32.458 INFO:teuthology.orchestra.run.smithi115.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-29T23:02:32.458 INFO:teuthology.orchestra.run.smithi115.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-29T23:02:32.458 INFO:teuthology.orchestra.run.smithi115.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-29T23:02:33.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:33 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:33.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:33 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:33.384 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:33 ntpd[22699]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-29T23:02:33.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:33 ntpd[22699]: can't open /var/log/ntpstats/rawstats.20230929: Permission denied 2023-09-29T23:02:33.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:33 ntpd[22699]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-29T23:02:33.385 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:33 ntpd[22699]: can't open /var/log/ntpstats/peerstats.20230929: Permission denied 2023-09-29T23:02:33.385 INFO:teuthology.orchestra.run.smithi156.stdout:29 Sep 23:02:33 ntpd[22699]: ntpd: time slew -0.000061 s 2023-09-29T23:02:33.385 INFO:teuthology.orchestra.run.smithi156.stdout:ntpd: time slew -0.000061s 2023-09-29T23:02:33.386 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:33 ntpd[22699]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-09-29T23:02:33.386 INFO:teuthology.orchestra.run.smithi156.stderr:29 Sep 23:02:33 ntpd[22699]: can't open /var/log/ntpstats/loopstats.20230929: Permission denied 2023-09-29T23:02:33.456 INFO:teuthology.orchestra.run.smithi156.stdout: remote refid st t when poll reach delay offset jitter 2023-09-29T23:02:33.456 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================== 2023-09-29T23:02:33.457 INFO:teuthology.orchestra.run.smithi156.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-29T23:02:33.457 INFO:teuthology.orchestra.run.smithi156.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-29T23:02:33.457 INFO:teuthology.orchestra.run.smithi156.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-29T23:02:33.457 INFO:teuthology.orchestra.run.smithi156.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-29T23:02:33.458 INFO:teuthology.run_tasks:Running task install... 2023-09-29T23:02:33.467 DEBUG:teuthology.task.install:project ceph 2023-09-29T23:02:33.467 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'}} 2023-09-29T23:02:33.467 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'} 2023-09-29T23:02:33.467 INFO:teuthology.task.install:Using flavor: default 2023-09-29T23:02:33.472 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-29T23:02:33.472 INFO:teuthology.task.install:extra packages: [] 2023-09-29T23:02:33.473 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-key list | grep Ceph 2023-09-29T23:02:33.473 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-key list | grep Ceph 2023-09-29T23:02:33.567 INFO:teuthology.orchestra.run.smithi115.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-09-29T23:02:33.602 INFO:teuthology.orchestra.run.smithi156.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-09-29T23:02:33.625 INFO:teuthology.orchestra.run.smithi115.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-09-29T23:02:33.626 INFO:teuthology.orchestra.run.smithi115.stdout:uid [ unknown] Ceph.com (release key) 2023-09-29T23:02:33.627 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-09-29T23:02:33.627 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=93dce5e17918f8aca65993a7a2dc40233a47b481 2023-09-29T23:02:33.659 INFO:teuthology.orchestra.run.smithi156.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-09-29T23:02:33.659 INFO:teuthology.orchestra.run.smithi156.stdout:uid [ unknown] Ceph.com (release key) 2023-09-29T23:02:33.660 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-09-29T23:02:33.660 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=93dce5e17918f8aca65993a7a2dc40233a47b481 2023-09-29T23:02:33.807 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default/ 2023-09-29T23:02:33.807 INFO:teuthology.task.install.deb:Package version is 17.2.6-1165-g93dce5e1-1focal 2023-09-29T23:02:33.867 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default/ 2023-09-29T23:02:33.868 INFO:teuthology.task.install.deb:Package version is 17.2.6-1165-g93dce5e1-1focal 2023-09-29T23:02:33.977 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:02:33.977 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-09-29T23:02:33.994 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get update 2023-09-29T23:02:34.037 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:02:34.037 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-09-29T23:02:34.054 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get update 2023-09-29T23:02:34.200 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-09-29T23:02:34.201 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-09-29T23:02:34.203 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-09-29T23:02:34.212 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-09-29T23:02:34.215 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-09-29T23:02:34.232 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-09-29T23:02:34.234 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-09-29T23:02:34.246 INFO:teuthology.orchestra.run.smithi115.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal InRelease 2023-09-29T23:02:34.267 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-09-29T23:02:34.290 INFO:teuthology.orchestra.run.smithi115.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal Release.gpg 2023-09-29T23:02:34.294 INFO:teuthology.orchestra.run.smithi156.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal InRelease 2023-09-29T23:02:34.312 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main i386 Packages [3,375 B] 2023-09-29T23:02:34.327 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:8 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-09-29T23:02:34.331 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-09-29T23:02:34.352 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-09-29T23:02:34.369 INFO:teuthology.orchestra.run.smithi156.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal Release.gpg 2023-09-29T23:02:34.406 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-09-29T23:02:34.466 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main i386 Packages [3,375 B] 2023-09-29T23:02:34.846 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 28.4 kB in 1s (45.2 kB/s) 2023-09-29T23:02:34.863 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 28.4 kB in 1s (42.9 kB/s) 2023-09-29T23:02:35.874 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2023-09-29T23:02:35.896 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-09-29T23:02:35.898 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1165-g93dce5e1-1focal cephadm=17.2.6-1165-g93dce5e1-1focal ceph-mds=17.2.6-1165-g93dce5e1-1focal ceph-mgr=17.2.6-1165-g93dce5e1-1focal ceph-common=17.2.6-1165-g93dce5e1-1focal ceph-fuse=17.2.6-1165-g93dce5e1-1focal ceph-test=17.2.6-1165-g93dce5e1-1focal ceph-volume=17.2.6-1165-g93dce5e1-1focal radosgw=17.2.6-1165-g93dce5e1-1focal python3-rados=17.2.6-1165-g93dce5e1-1focal python3-rgw=17.2.6-1165-g93dce5e1-1focal python3-cephfs=17.2.6-1165-g93dce5e1-1focal python3-rbd=17.2.6-1165-g93dce5e1-1focal libcephfs2=17.2.6-1165-g93dce5e1-1focal libcephfs-dev=17.2.6-1165-g93dce5e1-1focal librados2=17.2.6-1165-g93dce5e1-1focal librbd1=17.2.6-1165-g93dce5e1-1focal rbd-fuse=17.2.6-1165-g93dce5e1-1focal 2023-09-29T23:02:35.922 DEBUG:teuthology.orchestra.run.smithi156:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1165-g93dce5e1-1focal cephadm=17.2.6-1165-g93dce5e1-1focal ceph-mds=17.2.6-1165-g93dce5e1-1focal ceph-mgr=17.2.6-1165-g93dce5e1-1focal ceph-common=17.2.6-1165-g93dce5e1-1focal ceph-fuse=17.2.6-1165-g93dce5e1-1focal ceph-test=17.2.6-1165-g93dce5e1-1focal ceph-volume=17.2.6-1165-g93dce5e1-1focal radosgw=17.2.6-1165-g93dce5e1-1focal python3-rados=17.2.6-1165-g93dce5e1-1focal python3-rgw=17.2.6-1165-g93dce5e1-1focal python3-cephfs=17.2.6-1165-g93dce5e1-1focal python3-rbd=17.2.6-1165-g93dce5e1-1focal libcephfs2=17.2.6-1165-g93dce5e1-1focal libcephfs-dev=17.2.6-1165-g93dce5e1-1focal librados2=17.2.6-1165-g93dce5e1-1focal librbd1=17.2.6-1165-g93dce5e1-1focal rbd-fuse=17.2.6-1165-g93dce5e1-1focal 2023-09-29T23:02:35.965 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2023-09-29T23:02:35.985 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-09-29T23:02:36.162 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2023-09-29T23:02:36.162 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2023-09-29T23:02:36.166 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2023-09-29T23:02:36.167 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2023-09-29T23:02:36.332 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages were automatically installed and are no longer required: 2023-09-29T23:02:36.333 INFO:teuthology.orchestra.run.smithi156.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-09-29T23:02:36.333 INFO:teuthology.orchestra.run.smithi156.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-29T23:02:36.333 INFO:teuthology.orchestra.run.smithi156.stdout:The following additional packages will be installed: 2023-09-29T23:02:36.333 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-09-29T23:02:36.333 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-09-29T23:02:36.334 INFO:teuthology.orchestra.run.smithi156.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-09-29T23:02:36.334 INFO:teuthology.orchestra.run.smithi156.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-09-29T23:02:36.334 INFO:teuthology.orchestra.run.smithi156.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-09-29T23:02:36.334 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-09-29T23:02:36.335 INFO:teuthology.orchestra.run.smithi156.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-09-29T23:02:36.335 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-09-29T23:02:36.335 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 2023-09-29T23:02:36.335 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-09-29T23:02:36.335 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-09-29T23:02:36.335 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-09-29T23:02:36.335 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-09-29T23:02:36.335 INFO:teuthology.orchestra.run.smithi156.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-09-29T23:02:36.335 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-09-29T23:02:36.335 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2023-09-29T23:02:36.335 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2023-09-29T23:02:36.335 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-09-29T23:02:36.336 INFO:teuthology.orchestra.run.smithi156.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-09-29T23:02:36.336 INFO:teuthology.orchestra.run.smithi156.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2023-09-29T23:02:36.336 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket python3-webtest python3-werkzeug qttranslations5-l10n 2023-09-29T23:02:36.336 INFO:teuthology.orchestra.run.smithi156.stdout: socat xmlstarlet 2023-09-29T23:02:36.336 INFO:teuthology.orchestra.run.smithi156.stdout:Suggested packages: 2023-09-29T23:02:36.336 INFO:teuthology.orchestra.run.smithi156.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-09-29T23:02:36.336 INFO:teuthology.orchestra.run.smithi156.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-09-29T23:02:36.336 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-09-29T23:02:36.337 INFO:teuthology.orchestra.run.smithi156.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-09-29T23:02:36.337 INFO:teuthology.orchestra.run.smithi156.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-09-29T23:02:36.337 INFO:teuthology.orchestra.run.smithi156.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-09-29T23:02:36.337 INFO:teuthology.orchestra.run.smithi156.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-09-29T23:02:36.337 INFO:teuthology.orchestra.run.smithi156.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-09-29T23:02:36.337 INFO:teuthology.orchestra.run.smithi156.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-09-29T23:02:36.337 INFO:teuthology.orchestra.run.smithi156.stdout:Recommended packages: 2023-09-29T23:02:36.337 INFO:teuthology.orchestra.run.smithi156.stdout: btrfs-tools 2023-09-29T23:02:36.347 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2023-09-29T23:02:36.349 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-09-29T23:02:36.350 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-29T23:02:36.350 INFO:teuthology.orchestra.run.smithi115.stdout:The following additional packages will be installed: 2023-09-29T23:02:36.350 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-09-29T23:02:36.350 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-09-29T23:02:36.350 INFO:teuthology.orchestra.run.smithi115.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-09-29T23:02:36.350 INFO:teuthology.orchestra.run.smithi115.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-09-29T23:02:36.350 INFO:teuthology.orchestra.run.smithi115.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-09-29T23:02:36.350 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-09-29T23:02:36.350 INFO:teuthology.orchestra.run.smithi115.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-09-29T23:02:36.350 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-09-29T23:02:36.350 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 2023-09-29T23:02:36.351 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-09-29T23:02:36.351 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-09-29T23:02:36.351 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-09-29T23:02:36.351 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-09-29T23:02:36.351 INFO:teuthology.orchestra.run.smithi115.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-09-29T23:02:36.351 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-09-29T23:02:36.351 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2023-09-29T23:02:36.351 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2023-09-29T23:02:36.351 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-09-29T23:02:36.351 INFO:teuthology.orchestra.run.smithi115.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-09-29T23:02:36.351 INFO:teuthology.orchestra.run.smithi115.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2023-09-29T23:02:36.351 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket python3-webtest python3-werkzeug qttranslations5-l10n 2023-09-29T23:02:36.352 INFO:teuthology.orchestra.run.smithi115.stdout: socat xmlstarlet 2023-09-29T23:02:36.352 INFO:teuthology.orchestra.run.smithi115.stdout:Suggested packages: 2023-09-29T23:02:36.352 INFO:teuthology.orchestra.run.smithi115.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-09-29T23:02:36.352 INFO:teuthology.orchestra.run.smithi115.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-09-29T23:02:36.352 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-09-29T23:02:36.352 INFO:teuthology.orchestra.run.smithi115.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-09-29T23:02:36.352 INFO:teuthology.orchestra.run.smithi115.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-09-29T23:02:36.352 INFO:teuthology.orchestra.run.smithi115.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-09-29T23:02:36.353 INFO:teuthology.orchestra.run.smithi115.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-09-29T23:02:36.353 INFO:teuthology.orchestra.run.smithi115.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-09-29T23:02:36.353 INFO:teuthology.orchestra.run.smithi115.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-09-29T23:02:36.353 INFO:teuthology.orchestra.run.smithi115.stdout:Recommended packages: 2023-09-29T23:02:36.353 INFO:teuthology.orchestra.run.smithi115.stdout: btrfs-tools 2023-09-29T23:02:36.453 INFO:teuthology.orchestra.run.smithi156.stdout:The following NEW packages will be installed: 2023-09-29T23:02:36.454 INFO:teuthology.orchestra.run.smithi156.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-09-29T23:02:36.454 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-09-29T23:02:36.454 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-09-29T23:02:36.455 INFO:teuthology.orchestra.run.smithi156.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-09-29T23:02:36.455 INFO:teuthology.orchestra.run.smithi156.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-09-29T23:02:36.455 INFO:teuthology.orchestra.run.smithi156.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-09-29T23:02:36.455 INFO:teuthology.orchestra.run.smithi156.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-09-29T23:02:36.455 INFO:teuthology.orchestra.run.smithi156.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-natsort-doc 2023-09-29T23:02:36.456 INFO:teuthology.orchestra.run.smithi156.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2023-09-29T23:02:36.456 INFO:teuthology.orchestra.run.smithi156.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-09-29T23:02:36.456 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2023-09-29T23:02:36.456 INFO:teuthology.orchestra.run.smithi156.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-09-29T23:02:36.456 INFO:teuthology.orchestra.run.smithi156.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-09-29T23:02:36.456 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-09-29T23:02:36.456 INFO:teuthology.orchestra.run.smithi156.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2023-09-29T23:02:36.456 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2023-09-29T23:02:36.456 INFO:teuthology.orchestra.run.smithi156.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-09-29T23:02:36.456 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2023-09-29T23:02:36.456 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2023-09-29T23:02:36.457 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-09-29T23:02:36.457 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-09-29T23:02:36.457 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-09-29T23:02:36.457 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-09-29T23:02:36.457 INFO:teuthology.orchestra.run.smithi156.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-09-29T23:02:36.457 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages will be upgraded: 2023-09-29T23:02:36.458 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 librbd1 2023-09-29T23:02:36.462 INFO:teuthology.orchestra.run.smithi115.stdout:The following NEW packages will be installed: 2023-09-29T23:02:36.462 INFO:teuthology.orchestra.run.smithi115.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-09-29T23:02:36.462 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-09-29T23:02:36.462 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-09-29T23:02:36.463 INFO:teuthology.orchestra.run.smithi115.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-09-29T23:02:36.463 INFO:teuthology.orchestra.run.smithi115.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-09-29T23:02:36.463 INFO:teuthology.orchestra.run.smithi115.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-09-29T23:02:36.463 INFO:teuthology.orchestra.run.smithi115.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-09-29T23:02:36.464 INFO:teuthology.orchestra.run.smithi115.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-natsort-doc 2023-09-29T23:02:36.464 INFO:teuthology.orchestra.run.smithi115.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2023-09-29T23:02:36.464 INFO:teuthology.orchestra.run.smithi115.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-09-29T23:02:36.464 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2023-09-29T23:02:36.464 INFO:teuthology.orchestra.run.smithi115.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-09-29T23:02:36.464 INFO:teuthology.orchestra.run.smithi115.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-09-29T23:02:36.464 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-09-29T23:02:36.464 INFO:teuthology.orchestra.run.smithi115.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2023-09-29T23:02:36.464 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2023-09-29T23:02:36.464 INFO:teuthology.orchestra.run.smithi115.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-09-29T23:02:36.465 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2023-09-29T23:02:36.465 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2023-09-29T23:02:36.465 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-09-29T23:02:36.465 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-09-29T23:02:36.465 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-09-29T23:02:36.465 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-09-29T23:02:36.465 INFO:teuthology.orchestra.run.smithi115.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-09-29T23:02:36.466 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages will be upgraded: 2023-09-29T23:02:36.466 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 librbd1 2023-09-29T23:02:36.532 INFO:teuthology.orchestra.run.smithi115.stdout:2 upgraded, 108 newly installed, 0 to remove and 245 not upgraded. 2023-09-29T23:02:36.533 INFO:teuthology.orchestra.run.smithi115.stdout:Need to get 209 MB of archives. 2023-09-29T23:02:36.533 INFO:teuthology.orchestra.run.smithi115.stdout:After this operation, 980 MB of additional disk space will be used. 2023-09-29T23:02:36.533 INFO:teuthology.orchestra.run.smithi115.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-09-29T23:02:36.628 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-09-29T23:02:36.629 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-09-29T23:02:36.640 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-09-29T23:02:36.647 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-09-29T23:02:36.649 INFO:teuthology.orchestra.run.smithi156.stdout:2 upgraded, 108 newly installed, 0 to remove and 245 not upgraded. 2023-09-29T23:02:36.649 INFO:teuthology.orchestra.run.smithi156.stdout:Need to get 209 MB of archives. 2023-09-29T23:02:36.649 INFO:teuthology.orchestra.run.smithi156.stdout:After this operation, 980 MB of additional disk space will be used. 2023-09-29T23:02:36.649 INFO:teuthology.orchestra.run.smithi156.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-09-29T23:02:36.674 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-09-29T23:02:36.675 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-09-29T23:02:36.682 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-09-29T23:02:36.684 INFO:teuthology.orchestra.run.smithi156.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1165-g93dce5e1-1focal [3,501 kB] 2023-09-29T23:02:36.689 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1165-g93dce5e1-1focal [3,501 kB] 2023-09-29T23:02:36.718 INFO:teuthology.orchestra.run.smithi115.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-09-29T23:02:36.720 INFO:teuthology.orchestra.run.smithi115.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-09-29T23:02:36.728 INFO:teuthology.orchestra.run.smithi115.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-09-29T23:02:36.730 INFO:teuthology.orchestra.run.smithi115.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-09-29T23:02:36.730 INFO:teuthology.orchestra.run.smithi115.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-09-29T23:02:36.732 INFO:teuthology.orchestra.run.smithi115.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-09-29T23:02:36.733 INFO:teuthology.orchestra.run.smithi115.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-09-29T23:02:36.733 INFO:teuthology.orchestra.run.smithi115.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-09-29T23:02:36.734 INFO:teuthology.orchestra.run.smithi115.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-09-29T23:02:36.738 INFO:teuthology.orchestra.run.smithi115.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-09-29T23:02:36.755 INFO:teuthology.orchestra.run.smithi115.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-09-29T23:02:36.755 INFO:teuthology.orchestra.run.smithi115.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-09-29T23:02:36.755 INFO:teuthology.orchestra.run.smithi115.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-09-29T23:02:36.757 INFO:teuthology.orchestra.run.smithi115.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-09-29T23:02:36.757 INFO:teuthology.orchestra.run.smithi115.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-09-29T23:02:36.757 INFO:teuthology.orchestra.run.smithi115.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-09-29T23:02:36.759 INFO:teuthology.orchestra.run.smithi115.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-09-29T23:02:36.759 INFO:teuthology.orchestra.run.smithi115.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-09-29T23:02:36.761 INFO:teuthology.orchestra.run.smithi115.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-09-29T23:02:36.779 INFO:teuthology.orchestra.run.smithi115.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-09-29T23:02:36.779 INFO:teuthology.orchestra.run.smithi115.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-09-29T23:02:36.785 INFO:teuthology.orchestra.run.smithi115.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-09-29T23:02:36.786 INFO:teuthology.orchestra.run.smithi115.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-09-29T23:02:36.786 INFO:teuthology.orchestra.run.smithi115.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-09-29T23:02:36.787 INFO:teuthology.orchestra.run.smithi115.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-09-29T23:02:36.799 INFO:teuthology.orchestra.run.smithi115.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-09-29T23:02:36.802 INFO:teuthology.orchestra.run.smithi115.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-09-29T23:02:36.804 INFO:teuthology.orchestra.run.smithi115.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-09-29T23:02:36.804 INFO:teuthology.orchestra.run.smithi115.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-09-29T23:02:36.818 INFO:teuthology.orchestra.run.smithi115.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-09-29T23:02:36.819 INFO:teuthology.orchestra.run.smithi115.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-09-29T23:02:36.820 INFO:teuthology.orchestra.run.smithi115.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-09-29T23:02:36.821 INFO:teuthology.orchestra.run.smithi115.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-09-29T23:02:36.821 INFO:teuthology.orchestra.run.smithi115.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-09-29T23:02:36.960 INFO:teuthology.orchestra.run.smithi115.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-09-29T23:02:36.986 INFO:teuthology.orchestra.run.smithi115.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-09-29T23:02:36.988 INFO:teuthology.orchestra.run.smithi115.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-09-29T23:02:37.015 INFO:teuthology.orchestra.run.smithi115.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-09-29T23:02:37.015 INFO:teuthology.orchestra.run.smithi115.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-09-29T23:02:37.015 INFO:teuthology.orchestra.run.smithi115.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-09-29T23:02:37.016 INFO:teuthology.orchestra.run.smithi115.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-09-29T23:02:37.016 INFO:teuthology.orchestra.run.smithi115.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-09-29T23:02:37.016 INFO:teuthology.orchestra.run.smithi115.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-09-29T23:02:37.016 INFO:teuthology.orchestra.run.smithi115.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-09-29T23:02:37.024 INFO:teuthology.orchestra.run.smithi115.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-09-29T23:02:37.024 INFO:teuthology.orchestra.run.smithi115.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-09-29T23:02:37.043 INFO:teuthology.orchestra.run.smithi115.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-09-29T23:02:37.046 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-09-29T23:02:37.047 INFO:teuthology.orchestra.run.smithi115.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-09-29T23:02:37.050 INFO:teuthology.orchestra.run.smithi115.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-09-29T23:02:37.052 INFO:teuthology.orchestra.run.smithi115.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-09-29T23:02:37.053 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-09-29T23:02:37.054 INFO:teuthology.orchestra.run.smithi115.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-09-29T23:02:37.058 INFO:teuthology.orchestra.run.smithi115.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-09-29T23:02:37.060 INFO:teuthology.orchestra.run.smithi115.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-09-29T23:02:37.078 INFO:teuthology.orchestra.run.smithi115.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-09-29T23:02:37.080 INFO:teuthology.orchestra.run.smithi115.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-09-29T23:02:37.097 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-09-29T23:02:37.111 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-09-29T23:02:37.116 INFO:teuthology.orchestra.run.smithi115.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1165-g93dce5e1-1focal [3,552 kB] 2023-09-29T23:02:37.152 INFO:teuthology.orchestra.run.smithi115.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-09-29T23:02:37.152 INFO:teuthology.orchestra.run.smithi115.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-09-29T23:02:37.153 INFO:teuthology.orchestra.run.smithi115.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-09-29T23:02:37.153 INFO:teuthology.orchestra.run.smithi115.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-09-29T23:02:37.153 INFO:teuthology.orchestra.run.smithi115.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-09-29T23:02:37.154 INFO:teuthology.orchestra.run.smithi115.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-09-29T23:02:37.159 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1165-g93dce5e1-1focal [3,552 kB] 2023-09-29T23:02:37.177 INFO:teuthology.orchestra.run.smithi115.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-09-29T23:02:37.177 INFO:teuthology.orchestra.run.smithi115.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-09-29T23:02:37.177 INFO:teuthology.orchestra.run.smithi115.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-09-29T23:02:37.183 INFO:teuthology.orchestra.run.smithi115.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-09-29T23:02:37.203 INFO:teuthology.orchestra.run.smithi115.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-09-29T23:02:37.204 INFO:teuthology.orchestra.run.smithi115.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-09-29T23:02:37.205 INFO:teuthology.orchestra.run.smithi115.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-09-29T23:02:37.205 INFO:teuthology.orchestra.run.smithi115.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-09-29T23:02:37.208 INFO:teuthology.orchestra.run.smithi115.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-09-29T23:02:37.208 INFO:teuthology.orchestra.run.smithi115.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-09-29T23:02:37.237 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-09-29T23:02:37.242 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-09-29T23:02:37.272 INFO:teuthology.orchestra.run.smithi156.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-09-29T23:02:37.280 INFO:teuthology.orchestra.run.smithi115.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1165-g93dce5e1-1focal [758 kB] 2023-09-29T23:02:37.328 INFO:teuthology.orchestra.run.smithi115.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1165-g93dce5e1-1focal [414 kB] 2023-09-29T23:02:37.341 INFO:teuthology.orchestra.run.smithi115.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1165-g93dce5e1-1focal [22.5 kB] 2023-09-29T23:02:37.341 INFO:teuthology.orchestra.run.smithi115.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1165-g93dce5e1-1focal [200 kB] 2023-09-29T23:02:37.348 INFO:teuthology.orchestra.run.smithi115.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1165-g93dce5e1-1focal [47.1 kB] 2023-09-29T23:02:37.349 INFO:teuthology.orchestra.run.smithi115.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1165-g93dce5e1-1focal [385 kB] 2023-09-29T23:02:37.386 INFO:teuthology.orchestra.run.smithi115.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1165-g93dce5e1-1focal [5,569 kB] 2023-09-29T23:02:37.413 INFO:teuthology.orchestra.run.smithi156.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-09-29T23:02:37.422 INFO:teuthology.orchestra.run.smithi156.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-09-29T23:02:37.434 INFO:teuthology.orchestra.run.smithi156.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1165-g93dce5e1-1focal [758 kB] 2023-09-29T23:02:37.444 INFO:teuthology.orchestra.run.smithi156.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-09-29T23:02:37.502 INFO:teuthology.orchestra.run.smithi156.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1165-g93dce5e1-1focal [414 kB] 2023-09-29T23:02:37.515 INFO:teuthology.orchestra.run.smithi156.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1165-g93dce5e1-1focal [22.5 kB] 2023-09-29T23:02:37.516 INFO:teuthology.orchestra.run.smithi156.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1165-g93dce5e1-1focal [200 kB] 2023-09-29T23:02:37.567 INFO:teuthology.orchestra.run.smithi156.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1165-g93dce5e1-1focal [47.1 kB] 2023-09-29T23:02:37.569 INFO:teuthology.orchestra.run.smithi156.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1165-g93dce5e1-1focal [385 kB] 2023-09-29T23:02:37.581 INFO:teuthology.orchestra.run.smithi156.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1165-g93dce5e1-1focal [5,569 kB] 2023-09-29T23:02:37.615 INFO:teuthology.orchestra.run.smithi156.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-09-29T23:02:37.676 INFO:teuthology.orchestra.run.smithi115.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1165-g93dce5e1-1focal [116 kB] 2023-09-29T23:02:37.679 INFO:teuthology.orchestra.run.smithi115.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1165-g93dce5e1-1focal [480 kB] 2023-09-29T23:02:37.695 INFO:teuthology.orchestra.run.smithi115.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1165-g93dce5e1-1focal [27.7 MB] 2023-09-29T23:02:37.864 INFO:teuthology.orchestra.run.smithi156.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-09-29T23:02:38.058 INFO:teuthology.orchestra.run.smithi156.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-09-29T23:02:38.077 INFO:teuthology.orchestra.run.smithi156.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-09-29T23:02:38.081 INFO:teuthology.orchestra.run.smithi156.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1165-g93dce5e1-1focal [116 kB] 2023-09-29T23:02:38.091 INFO:teuthology.orchestra.run.smithi156.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-09-29T23:02:38.144 INFO:teuthology.orchestra.run.smithi156.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-09-29T23:02:38.151 INFO:teuthology.orchestra.run.smithi156.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-09-29T23:02:38.154 INFO:teuthology.orchestra.run.smithi156.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-09-29T23:02:38.159 INFO:teuthology.orchestra.run.smithi156.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-09-29T23:02:38.161 INFO:teuthology.orchestra.run.smithi156.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-09-29T23:02:38.173 INFO:teuthology.orchestra.run.smithi156.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-09-29T23:02:38.183 INFO:teuthology.orchestra.run.smithi156.stdout:Get:33 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1165-g93dce5e1-1focal [480 kB] 2023-09-29T23:02:38.193 INFO:teuthology.orchestra.run.smithi156.stdout:Get:34 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1165-g93dce5e1-1focal [27.7 MB] 2023-09-29T23:02:38.339 INFO:teuthology.orchestra.run.smithi156.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-09-29T23:02:38.422 INFO:teuthology.orchestra.run.smithi156.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-09-29T23:02:38.607 INFO:teuthology.orchestra.run.smithi156.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-09-29T23:02:38.642 INFO:teuthology.orchestra.run.smithi156.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-09-29T23:02:38.707 INFO:teuthology.orchestra.run.smithi156.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-09-29T23:02:38.747 INFO:teuthology.orchestra.run.smithi156.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-09-29T23:02:38.753 INFO:teuthology.orchestra.run.smithi156.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-09-29T23:02:38.864 INFO:teuthology.orchestra.run.smithi156.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-09-29T23:02:38.864 INFO:teuthology.orchestra.run.smithi156.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-09-29T23:02:38.868 INFO:teuthology.orchestra.run.smithi156.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-09-29T23:02:38.872 INFO:teuthology.orchestra.run.smithi156.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-09-29T23:02:39.048 INFO:teuthology.orchestra.run.smithi156.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-09-29T23:02:39.236 INFO:teuthology.orchestra.run.smithi115.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1165-g93dce5e1-1focal [6,453 kB] 2023-09-29T23:02:39.463 INFO:teuthology.orchestra.run.smithi156.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-09-29T23:02:39.495 INFO:teuthology.orchestra.run.smithi156.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-09-29T23:02:39.499 INFO:teuthology.orchestra.run.smithi156.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-09-29T23:02:39.503 INFO:teuthology.orchestra.run.smithi115.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1165-g93dce5e1-1focal [221 kB] 2023-09-29T23:02:39.528 INFO:teuthology.orchestra.run.smithi115.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1165-g93dce5e1-1focal [153 kB] 2023-09-29T23:02:39.531 INFO:teuthology.orchestra.run.smithi115.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1165-g93dce5e1-1focal [1,589 kB] 2023-09-29T23:02:39.547 INFO:teuthology.orchestra.run.smithi156.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-09-29T23:02:39.579 INFO:teuthology.orchestra.run.smithi156.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-09-29T23:02:39.607 INFO:teuthology.orchestra.run.smithi156.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-09-29T23:02:39.610 INFO:teuthology.orchestra.run.smithi156.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-09-29T23:02:39.614 INFO:teuthology.orchestra.run.smithi115.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1165-g93dce5e1-1focal [7,845 kB] 2023-09-29T23:02:39.618 INFO:teuthology.orchestra.run.smithi156.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-09-29T23:02:40.027 INFO:teuthology.orchestra.run.smithi115.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1165-g93dce5e1-1focal [28.7 MB] 2023-09-29T23:02:40.053 INFO:teuthology.orchestra.run.smithi156.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-09-29T23:02:40.129 INFO:teuthology.orchestra.run.smithi156.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-09-29T23:02:40.296 INFO:teuthology.orchestra.run.smithi156.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-09-29T23:02:40.582 INFO:teuthology.orchestra.run.smithi156.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1165-g93dce5e1-1focal [6,453 kB] 2023-09-29T23:02:40.984 INFO:teuthology.orchestra.run.smithi156.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-09-29T23:02:40.984 INFO:teuthology.orchestra.run.smithi156.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-09-29T23:02:40.986 INFO:teuthology.orchestra.run.smithi156.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-09-29T23:02:40.987 INFO:teuthology.orchestra.run.smithi156.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-09-29T23:02:40.988 INFO:teuthology.orchestra.run.smithi156.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-09-29T23:02:40.989 INFO:teuthology.orchestra.run.smithi156.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-09-29T23:02:40.990 INFO:teuthology.orchestra.run.smithi156.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-09-29T23:02:40.992 INFO:teuthology.orchestra.run.smithi156.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-09-29T23:02:40.993 INFO:teuthology.orchestra.run.smithi156.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-09-29T23:02:41.065 INFO:teuthology.orchestra.run.smithi156.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-09-29T23:02:41.068 INFO:teuthology.orchestra.run.smithi156.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1165-g93dce5e1-1focal [221 kB] 2023-09-29T23:02:41.104 INFO:teuthology.orchestra.run.smithi156.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1165-g93dce5e1-1focal [153 kB] 2023-09-29T23:02:41.108 INFO:teuthology.orchestra.run.smithi156.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1165-g93dce5e1-1focal [1,589 kB] 2023-09-29T23:02:41.237 INFO:teuthology.orchestra.run.smithi156.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-09-29T23:02:41.243 INFO:teuthology.orchestra.run.smithi156.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1165-g93dce5e1-1focal [7,845 kB] 2023-09-29T23:02:41.617 INFO:teuthology.orchestra.run.smithi156.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-09-29T23:02:41.669 INFO:teuthology.orchestra.run.smithi156.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-09-29T23:02:41.685 INFO:teuthology.orchestra.run.smithi115.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1165-g93dce5e1-1focal [3,928 B] 2023-09-29T23:02:41.686 INFO:teuthology.orchestra.run.smithi115.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1165-g93dce5e1-1focal [868 kB] 2023-09-29T23:02:41.701 INFO:teuthology.orchestra.run.smithi115.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1165-g93dce5e1-1focal [2,404 kB] 2023-09-29T23:02:41.705 INFO:teuthology.orchestra.run.smithi156.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-09-29T23:02:41.727 INFO:teuthology.orchestra.run.smithi115.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1165-g93dce5e1-1focal [78.9 kB] 2023-09-29T23:02:41.729 INFO:teuthology.orchestra.run.smithi115.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1165-g93dce5e1-1focal [117 kB] 2023-09-29T23:02:41.742 INFO:teuthology.orchestra.run.smithi115.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1165-g93dce5e1-1focal [1,760 kB] 2023-09-29T23:02:41.805 INFO:teuthology.orchestra.run.smithi156.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-09-29T23:02:41.835 INFO:teuthology.orchestra.run.smithi115.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1165-g93dce5e1-1focal [7,861 kB] 2023-09-29T23:02:41.852 INFO:teuthology.orchestra.run.smithi156.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-09-29T23:02:41.896 INFO:teuthology.orchestra.run.smithi156.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1165-g93dce5e1-1focal [28.7 MB] 2023-09-29T23:02:42.007 INFO:teuthology.orchestra.run.smithi156.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-09-29T23:02:42.017 INFO:teuthology.orchestra.run.smithi156.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-09-29T23:02:42.165 INFO:teuthology.orchestra.run.smithi156.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-09-29T23:02:42.189 INFO:teuthology.orchestra.run.smithi156.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-09-29T23:02:42.254 INFO:teuthology.orchestra.run.smithi115.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1165-g93dce5e1-1focal [4,048 B] 2023-09-29T23:02:42.254 INFO:teuthology.orchestra.run.smithi115.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1165-g93dce5e1-1focal [56.2 MB] 2023-09-29T23:02:42.355 INFO:teuthology.orchestra.run.smithi156.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-09-29T23:02:42.474 INFO:teuthology.orchestra.run.smithi156.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-09-29T23:02:42.520 INFO:teuthology.orchestra.run.smithi156.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-09-29T23:02:42.643 INFO:teuthology.orchestra.run.smithi156.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-09-29T23:02:42.942 INFO:teuthology.orchestra.run.smithi156.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-09-29T23:02:42.944 INFO:teuthology.orchestra.run.smithi156.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-09-29T23:02:42.948 INFO:teuthology.orchestra.run.smithi156.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-09-29T23:02:42.949 INFO:teuthology.orchestra.run.smithi156.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-09-29T23:02:42.959 INFO:teuthology.orchestra.run.smithi156.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-09-29T23:02:42.964 INFO:teuthology.orchestra.run.smithi156.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-09-29T23:02:42.965 INFO:teuthology.orchestra.run.smithi156.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-09-29T23:02:43.130 INFO:teuthology.orchestra.run.smithi156.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-09-29T23:02:43.540 INFO:teuthology.orchestra.run.smithi156.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-09-29T23:02:43.557 INFO:teuthology.orchestra.run.smithi156.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-09-29T23:02:44.947 INFO:teuthology.orchestra.run.smithi156.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1165-g93dce5e1-1focal [3,928 B] 2023-09-29T23:02:44.948 INFO:teuthology.orchestra.run.smithi156.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1165-g93dce5e1-1focal [868 kB] 2023-09-29T23:02:44.962 INFO:teuthology.orchestra.run.smithi156.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1165-g93dce5e1-1focal [2,404 kB] 2023-09-29T23:02:45.113 INFO:teuthology.orchestra.run.smithi156.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1165-g93dce5e1-1focal [78.9 kB] 2023-09-29T23:02:45.115 INFO:teuthology.orchestra.run.smithi156.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1165-g93dce5e1-1focal [117 kB] 2023-09-29T23:02:45.130 INFO:teuthology.orchestra.run.smithi156.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1165-g93dce5e1-1focal [1,760 kB] 2023-09-29T23:02:45.206 INFO:teuthology.orchestra.run.smithi156.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1165-g93dce5e1-1focal [7,861 kB] 2023-09-29T23:02:45.277 INFO:teuthology.orchestra.run.smithi115.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1165-g93dce5e1-1focal [229 kB] 2023-09-29T23:02:45.282 INFO:teuthology.orchestra.run.smithi115.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1165-g93dce5e1-1focal [21.9 kB] 2023-09-29T23:02:45.282 INFO:teuthology.orchestra.run.smithi115.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1165-g93dce5e1-1focal [17.0 MB] 2023-09-29T23:02:45.833 INFO:teuthology.orchestra.run.smithi156.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1165-g93dce5e1-1focal [4,048 B] 2023-09-29T23:02:45.833 INFO:teuthology.orchestra.run.smithi156.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1165-g93dce5e1-1focal [56.2 MB] 2023-09-29T23:02:46.036 INFO:teuthology.orchestra.run.smithi115.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1165-g93dce5e1-1focal [79.5 kB] 2023-09-29T23:02:46.657 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 209 MB in 10s (21.9 MB/s) 2023-09-29T23:02:46.797 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-09-29T23:02:46.854 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141758 files and directories currently installed.) 2023-09-29T23:02:46.858 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-09-29T23:02:46.937 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-09-29T23:02:47.276 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../001-librbd1_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:47.402 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librbd1 (17.2.6-1165-g93dce5e1-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-09-29T23:02:48.099 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../002-librados2_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:48.240 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librados2 (17.2.6-1165-g93dce5e1-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-09-29T23:02:48.351 INFO:teuthology.orchestra.run.smithi156.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1165-g93dce5e1-1focal [229 kB] 2023-09-29T23:02:48.356 INFO:teuthology.orchestra.run.smithi156.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1165-g93dce5e1-1focal [21.9 kB] 2023-09-29T23:02:48.357 INFO:teuthology.orchestra.run.smithi156.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1165-g93dce5e1-1focal [17.0 MB] 2023-09-29T23:02:48.943 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libcephfs2. 2023-09-29T23:02:48.959 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../003-libcephfs2_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:48.992 INFO:teuthology.orchestra.run.smithi156.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1165-g93dce5e1-1focal [79.5 kB] 2023-09-29T23:02:49.002 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libcephfs2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:49.354 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rados. 2023-09-29T23:02:49.374 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../004-python3-rados_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:49.470 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rados (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:49.636 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 209 MB in 13s (16.7 MB/s) 2023-09-29T23:02:49.830 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-09-29T23:02:49.887 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141758 files and directories currently installed.) 2023-09-29T23:02:49.892 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-09-29T23:02:49.898 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-09-29T23:02:49.915 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../005-python3-ceph-argparse_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:02:49.957 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-ceph-argparse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:50.029 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-09-29T23:02:50.192 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cephfs. 2023-09-29T23:02:50.209 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../006-python3-cephfs_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:50.250 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cephfs (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:50.391 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../001-librbd1_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:50.517 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librbd1 (17.2.6-1165-g93dce5e1-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-09-29T23:02:50.561 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-ceph-common. 2023-09-29T23:02:50.579 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../007-python3-ceph-common_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:02:50.619 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:50.889 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-prettytable. 2023-09-29T23:02:50.908 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../008-python3-prettytable_0.7.2-5_all.deb ... 2023-09-29T23:02:50.972 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-09-29T23:02:51.208 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rbd. 2023-09-29T23:02:51.225 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../009-python3-rbd_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:51.263 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../002-librados2_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:51.266 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rbd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:51.371 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librados2 (17.2.6-1165-g93dce5e1-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-09-29T23:02:51.652 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-09-29T23:02:51.668 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../010-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-09-29T23:02:51.710 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-09-29T23:02:52.097 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-09-29T23:02:52.108 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libcephfs2. 2023-09-29T23:02:52.115 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../011-librabbitmq4_0.10.0-1_amd64.deb ... 2023-09-29T23:02:52.126 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../003-libcephfs2_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:52.155 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-09-29T23:02:52.166 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libcephfs2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:52.433 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-09-29T23:02:52.449 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../012-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-09-29T23:02:52.485 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rados. 2023-09-29T23:02:52.491 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-09-29T23:02:52.501 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../004-python3-rados_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:52.543 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rados (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:52.877 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-09-29T23:02:52.895 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../013-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-09-29T23:02:52.935 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-09-29T23:02:53.180 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-09-29T23:02:53.196 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../005-python3-ceph-argparse_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:02:53.238 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-ceph-argparse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:53.288 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-09-29T23:02:53.306 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../014-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-09-29T23:02:53.346 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-09-29T23:02:53.524 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cephfs. 2023-09-29T23:02:53.540 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../006-python3-cephfs_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:53.582 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cephfs (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:53.833 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-09-29T23:02:53.851 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../015-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-09-29T23:02:53.902 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-29T23:02:53.927 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-ceph-common. 2023-09-29T23:02:53.942 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../007-python3-ceph-common_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:02:53.976 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:54.263 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-prettytable. 2023-09-29T23:02:54.282 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../008-python3-prettytable_0.7.2-5_all.deb ... 2023-09-29T23:02:54.312 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-09-29T23:02:54.437 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-09-29T23:02:54.457 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../016-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-09-29T23:02:54.495 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-29T23:02:54.599 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rbd. 2023-09-29T23:02:54.617 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../009-python3-rbd_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:54.657 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rbd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:55.076 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-09-29T23:02:55.094 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../010-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-09-29T23:02:55.129 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-09-29T23:02:55.134 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-09-29T23:02:55.145 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../017-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-09-29T23:02:55.187 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-29T23:02:55.479 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-09-29T23:02:55.495 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../011-librabbitmq4_0.10.0-1_amd64.deb ... 2023-09-29T23:02:55.529 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-09-29T23:02:55.574 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-09-29T23:02:55.589 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../018-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-09-29T23:02:55.624 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-09-29T23:02:55.880 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-09-29T23:02:55.896 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../012-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-09-29T23:02:55.966 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-09-29T23:02:56.002 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librgw2. 2023-09-29T23:02:56.017 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../019-librgw2_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:56.060 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librgw2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:56.378 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-09-29T23:02:56.395 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../013-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-09-29T23:02:56.436 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-09-29T23:02:56.812 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rgw. 2023-09-29T23:02:56.820 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-09-29T23:02:56.831 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../020-python3-rgw_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:56.838 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../014-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-09-29T23:02:56.870 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:56.878 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-09-29T23:02:57.232 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liboath0. 2023-09-29T23:02:57.250 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-09-29T23:02:57.282 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-09-29T23:02:57.298 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-09-29T23:02:57.315 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../015-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-09-29T23:02:57.417 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-29T23:02:57.626 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libradosstriper1. 2023-09-29T23:02:57.644 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../022-libradosstriper1_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:57.684 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libradosstriper1 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:57.985 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-09-29T23:02:58.005 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../016-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-09-29T23:02:58.043 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-29T23:02:58.171 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-common. 2023-09-29T23:02:58.188 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../023-ceph-common_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:58.229 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:02:58.388 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-09-29T23:02:58.404 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../017-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-09-29T23:02:58.438 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-29T23:02:58.866 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-09-29T23:02:58.883 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../018-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-09-29T23:02:58.925 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-09-29T23:02:59.286 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librgw2. 2023-09-29T23:02:59.305 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../019-librgw2_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:02:59.344 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librgw2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:00.122 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rgw. 2023-09-29T23:03:00.141 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../020-python3-rgw_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:00.172 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:00.592 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liboath0. 2023-09-29T23:03:00.607 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-09-29T23:03:00.650 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-09-29T23:03:00.993 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-base. 2023-09-29T23:03:00.994 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libradosstriper1. 2023-09-29T23:03:01.011 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../022-libradosstriper1_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:01.011 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../024-ceph-base_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:01.052 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libradosstriper1 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:01.061 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-base (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:01.472 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-common. 2023-09-29T23:03:01.490 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../023-ceph-common_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:01.522 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:01.998 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cryptography. 2023-09-29T23:03:02.015 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../025-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-09-29T23:03:02.047 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-09-29T23:03:02.384 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-openssl. 2023-09-29T23:03:02.400 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../026-python3-openssl_19.0.0-1build1_all.deb ... 2023-09-29T23:03:02.458 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-09-29T23:03:02.678 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-09-29T23:03:02.695 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../027-ceph-mgr-modules-core_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:03:02.729 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:03.125 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-bcrypt. 2023-09-29T23:03:03.144 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../028-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-09-29T23:03:03.183 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-09-29T23:03:03.428 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cherrypy3. 2023-09-29T23:03:03.447 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../029-python3-cherrypy3_8.9.1-6_all.deb ... 2023-09-29T23:03:03.486 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-09-29T23:03:03.864 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-natsort. 2023-09-29T23:03:03.880 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../030-python3-natsort_7.0.1-1_all.deb ... 2023-09-29T23:03:03.922 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-09-29T23:03:04.177 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-base. 2023-09-29T23:03:04.193 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../024-ceph-base_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:04.246 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-base (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:04.250 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jwt. 2023-09-29T23:03:04.270 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../031-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-09-29T23:03:04.308 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-09-29T23:03:04.619 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-logutils. 2023-09-29T23:03:04.639 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../032-python3-logutils_0.3.3-7_all.deb ... 2023-09-29T23:03:04.678 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-09-29T23:03:04.989 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-markupsafe. 2023-09-29T23:03:05.007 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../033-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-09-29T23:03:05.048 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-09-29T23:03:05.285 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cryptography. 2023-09-29T23:03:05.303 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../025-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-09-29T23:03:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-09-29T23:03:05.434 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-mako. 2023-09-29T23:03:05.451 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../034-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-09-29T23:03:05.492 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-09-29T23:03:05.714 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-openssl. 2023-09-29T23:03:05.731 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../026-python3-openssl_19.0.0-1build1_all.deb ... 2023-09-29T23:03:05.763 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-09-29T23:03:05.846 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-simplegeneric. 2023-09-29T23:03:05.861 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../035-python3-simplegeneric_0.8.1-3_all.deb ... 2023-09-29T23:03:05.904 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-09-29T23:03:06.041 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-09-29T23:03:06.057 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../027-ceph-mgr-modules-core_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:03:06.099 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:06.190 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-singledispatch. 2023-09-29T23:03:06.205 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../036-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-09-29T23:03:06.281 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-09-29T23:03:06.555 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-bcrypt. 2023-09-29T23:03:06.574 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../028-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-09-29T23:03:06.584 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-webob. 2023-09-29T23:03:06.600 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../037-python3-webob_1%3a1.8.5-2_all.deb ... 2023-09-29T23:03:06.613 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-09-29T23:03:06.642 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-09-29T23:03:06.941 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cherrypy3. 2023-09-29T23:03:06.956 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../029-python3-cherrypy3_8.9.1-6_all.deb ... 2023-09-29T23:03:06.978 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-soupsieve. 2023-09-29T23:03:06.995 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../038-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-09-29T23:03:06.998 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-09-29T23:03:07.036 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-09-29T23:03:07.366 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-bs4. 2023-09-29T23:03:07.383 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../039-python3-bs4_4.8.2-1_all.deb ... 2023-09-29T23:03:07.403 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-natsort. 2023-09-29T23:03:07.419 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../030-python3-natsort_7.0.1-1_all.deb ... 2023-09-29T23:03:07.422 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-09-29T23:03:07.461 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-09-29T23:03:07.784 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-waitress. 2023-09-29T23:03:07.800 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../040-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-09-29T23:03:07.806 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jwt. 2023-09-29T23:03:07.823 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../031-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-09-29T23:03:07.845 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-09-29T23:03:07.864 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-09-29T23:03:08.195 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-tempita. 2023-09-29T23:03:08.214 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-6_all.deb ... 2023-09-29T23:03:08.253 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-09-29T23:03:08.477 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-logutils. 2023-09-29T23:03:08.497 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../032-python3-logutils_0.3.3-7_all.deb ... 2023-09-29T23:03:08.548 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-paste. 2023-09-29T23:03:08.564 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../042-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-09-29T23:03:08.606 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-09-29T23:03:08.926 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-09-29T23:03:08.943 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-09-29T23:03:09.009 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-09-29T23:03:09.018 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-09-29T23:03:09.261 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pastedeploy. 2023-09-29T23:03:09.280 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../044-python3-pastedeploy_2.1.0-1_all.deb ... 2023-09-29T23:03:09.311 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-09-29T23:03:09.355 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-markupsafe. 2023-09-29T23:03:09.374 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../033-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-09-29T23:03:09.413 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-09-29T23:03:09.639 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-webtest. 2023-09-29T23:03:09.656 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../045-python3-webtest_2.0.32-2_all.deb ... 2023-09-29T23:03:09.697 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-09-29T23:03:09.741 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-mako. 2023-09-29T23:03:09.761 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../034-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-09-29T23:03:09.799 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-09-29T23:03:10.008 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pecan. 2023-09-29T23:03:10.023 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../046-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-09-29T23:03:10.092 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-09-29T23:03:10.144 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-simplegeneric. 2023-09-29T23:03:10.162 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../035-python3-simplegeneric_0.8.1-3_all.deb ... 2023-09-29T23:03:10.236 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-09-29T23:03:10.564 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-singledispatch. 2023-09-29T23:03:10.582 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../036-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-09-29T23:03:10.622 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-09-29T23:03:10.958 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-webob. 2023-09-29T23:03:10.975 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../037-python3-webob_1%3a1.8.5-2_all.deb ... 2023-09-29T23:03:11.016 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-09-29T23:03:11.122 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-werkzeug. 2023-09-29T23:03:11.140 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../047-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-09-29T23:03:11.180 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-09-29T23:03:11.353 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-soupsieve. 2023-09-29T23:03:11.369 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../038-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-09-29T23:03:11.419 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-09-29T23:03:11.541 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-09-29T23:03:11.557 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../048-libsqlite3-mod-ceph_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:11.599 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:11.748 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-bs4. 2023-09-29T23:03:11.763 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../039-python3-bs4_4.8.2-1_all.deb ... 2023-09-29T23:03:11.806 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-09-29T23:03:11.977 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr. 2023-09-29T23:03:11.993 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../049-ceph-mgr_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:12.035 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:12.184 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-waitress. 2023-09-29T23:03:12.202 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../040-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-09-29T23:03:12.279 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-09-29T23:03:12.565 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mon. 2023-09-29T23:03:12.580 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../050-ceph-mon_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:12.613 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mon (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:12.637 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-tempita. 2023-09-29T23:03:12.653 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-6_all.deb ... 2023-09-29T23:03:12.695 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-09-29T23:03:13.032 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-paste. 2023-09-29T23:03:13.048 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../042-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-09-29T23:03:13.109 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-09-29T23:03:13.469 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-09-29T23:03:13.486 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-09-29T23:03:13.526 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-09-29T23:03:13.725 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-osd. 2023-09-29T23:03:13.743 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../051-ceph-osd_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:13.783 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-osd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:13.838 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pastedeploy. 2023-09-29T23:03:13.857 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../044-python3-pastedeploy_2.1.0-1_all.deb ... 2023-09-29T23:03:13.896 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-09-29T23:03:14.264 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-webtest. 2023-09-29T23:03:14.282 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../045-python3-webtest_2.0.32-2_all.deb ... 2023-09-29T23:03:14.332 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-09-29T23:03:14.677 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pecan. 2023-09-29T23:03:14.697 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../046-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-09-29T23:03:14.735 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-09-29T23:03:15.107 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-werkzeug. 2023-09-29T23:03:15.124 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../047-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-09-29T23:03:15.199 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-09-29T23:03:15.561 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-09-29T23:03:15.579 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../048-libsqlite3-mod-ceph_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:15.610 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:15.989 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr. 2023-09-29T23:03:16.004 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../049-ceph-mgr_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:16.063 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:16.553 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph. 2023-09-29T23:03:16.571 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../052-ceph_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:16.608 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mon. 2023-09-29T23:03:16.610 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:16.626 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../050-ceph-mon_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:16.666 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mon (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:16.955 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-fuse. 2023-09-29T23:03:16.974 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../053-ceph-fuse_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:17.013 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:17.441 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mds. 2023-09-29T23:03:17.459 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../054-ceph-mds_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:17.499 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mds (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:17.871 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-osd. 2023-09-29T23:03:17.887 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../051-ceph-osd_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:17.928 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-osd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:18.035 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephadm. 2023-09-29T23:03:18.052 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../055-cephadm_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:18.093 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:18.439 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jinja2. 2023-09-29T23:03:18.458 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2_all.deb ... 2023-09-29T23:03:18.504 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-09-29T23:03:18.815 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-09-29T23:03:18.834 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:03:18.873 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:19.243 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-repoze.lru. 2023-09-29T23:03:19.259 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../058-python3-repoze.lru_0.7-2_all.deb ... 2023-09-29T23:03:19.301 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-09-29T23:03:19.562 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libjs-underscore. 2023-09-29T23:03:19.582 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../059-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-09-29T23:03:19.620 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-09-29T23:03:19.872 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-09-29T23:03:19.891 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../060-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-09-29T23:03:19.930 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-09-29T23:03:20.275 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-routes. 2023-09-29T23:03:20.292 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../061-python3-routes_2.4.1-2_all.deb ... 2023-09-29T23:03:20.333 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-09-29T23:03:20.677 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-09-29T23:03:20.693 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../062-ceph-mgr-dashboard_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:03:20.735 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:20.740 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph. 2023-09-29T23:03:20.757 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../052-ceph_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:20.823 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:21.176 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-fuse. 2023-09-29T23:03:21.194 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../053-ceph-fuse_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:21.234 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:21.239 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-decorator. 2023-09-29T23:03:21.256 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../063-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-09-29T23:03:21.297 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-09-29T23:03:21.608 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-09-29T23:03:21.624 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../064-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-09-29T23:03:21.666 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-09-29T23:03:21.705 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mds. 2023-09-29T23:03:21.723 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../054-ceph-mds_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:21.762 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mds (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:22.002 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-scipy. 2023-09-29T23:03:22.018 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../065-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-09-29T23:03:22.060 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-09-29T23:03:22.249 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package cephadm. 2023-09-29T23:03:22.288 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../055-cephadm_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:22.340 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:22.702 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jinja2. 2023-09-29T23:03:22.719 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2_all.deb ... 2023-09-29T23:03:22.760 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-09-29T23:03:23.105 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-09-29T23:03:23.123 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:03:23.196 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:23.342 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-09-29T23:03:23.362 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../066-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-09-29T23:03:23.410 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-09-29T23:03:23.566 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-repoze.lru. 2023-09-29T23:03:23.583 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../058-python3-repoze.lru_0.7-2_all.deb ... 2023-09-29T23:03:23.624 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-09-29T23:03:23.911 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libjs-underscore. 2023-09-29T23:03:23.930 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../059-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-09-29T23:03:23.969 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-09-29T23:03:23.972 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-joblib. 2023-09-29T23:03:23.991 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../067-python3-joblib_0.14.0-3_all.deb ... 2023-09-29T23:03:24.030 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-09-29T23:03:24.271 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-09-29T23:03:24.288 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../060-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-09-29T23:03:24.367 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-sklearn. 2023-09-29T23:03:24.386 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../068-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-09-29T23:03:24.458 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-09-29T23:03:24.496 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-09-29T23:03:25.077 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-routes. 2023-09-29T23:03:25.091 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../061-python3-routes_2.4.1-2_all.deb ... 2023-09-29T23:03:25.132 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-09-29T23:03:25.194 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-09-29T23:03:25.215 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../069-ceph-mgr-diskprediction-local_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:03:25.252 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:25.486 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-09-29T23:03:25.503 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../062-ceph-mgr-dashboard_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:03:25.544 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:26.056 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-decorator. 2023-09-29T23:03:26.074 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../063-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-09-29T23:03:26.106 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-09-29T23:03:26.380 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cachetools. 2023-09-29T23:03:26.396 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../070-python3-cachetools_4.0.0-1_all.deb ... 2023-09-29T23:03:26.441 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-09-29T23:03:26.442 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-09-29T23:03:26.459 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../064-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-09-29T23:03:26.534 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-09-29T23:03:26.878 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-scipy. 2023-09-29T23:03:26.895 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../065-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-09-29T23:03:26.936 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-09-29T23:03:26.974 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyasn1. 2023-09-29T23:03:26.991 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-09-29T23:03:27.032 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-09-29T23:03:27.394 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-09-29T23:03:27.410 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-09-29T23:03:27.452 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-09-29T23:03:27.746 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rsa. 2023-09-29T23:03:27.767 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../073-python3-rsa_4.0-3_all.deb ... 2023-09-29T23:03:27.821 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rsa (4.0-3) ... 2023-09-29T23:03:28.108 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-google-auth. 2023-09-29T23:03:28.125 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../074-python3-google-auth_1.5.1-2_all.deb ... 2023-09-29T23:03:28.166 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-09-29T23:03:28.354 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-09-29T23:03:28.371 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../066-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-09-29T23:03:28.412 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-09-29T23:03:28.503 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-blinker. 2023-09-29T23:03:28.523 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../075-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-09-29T23:03:28.560 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-09-29T23:03:28.889 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-oauthlib. 2023-09-29T23:03:28.906 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../076-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-09-29T23:03:28.946 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-09-29T23:03:28.974 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-joblib. 2023-09-29T23:03:28.994 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../067-python3-joblib_0.14.0-3_all.deb ... 2023-09-29T23:03:29.032 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-09-29T23:03:29.267 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-09-29T23:03:29.287 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../077-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-09-29T23:03:29.325 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-09-29T23:03:29.445 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-sklearn. 2023-09-29T23:03:29.461 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../068-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-09-29T23:03:29.502 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-09-29T23:03:29.661 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-websocket. 2023-09-29T23:03:29.678 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../078-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-09-29T23:03:29.719 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-09-29T23:03:30.056 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-kubernetes. 2023-09-29T23:03:30.073 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../079-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-09-29T23:03:30.114 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-09-29T23:03:30.228 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-09-29T23:03:30.244 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../069-ceph-mgr-diskprediction-local_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:03:30.311 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:30.702 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-09-29T23:03:30.720 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../080-ceph-mgr-k8sevents_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:03:30.760 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:31.157 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libonig5:amd64. 2023-09-29T23:03:31.176 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../081-libonig5_6.9.4-1_amd64.deb ... 2023-09-29T23:03:31.215 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-09-29T23:03:31.472 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cachetools. 2023-09-29T23:03:31.491 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../070-python3-cachetools_4.0.0-1_all.deb ... 2023-09-29T23:03:31.530 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-09-29T23:03:31.552 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libjq1:amd64. 2023-09-29T23:03:31.571 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../082-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-09-29T23:03:31.635 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-09-29T23:03:31.833 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyasn1. 2023-09-29T23:03:31.853 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-09-29T23:03:31.883 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-09-29T23:03:31.896 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package jq. 2023-09-29T23:03:31.913 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../083-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-09-29T23:03:31.954 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-09-29T23:03:32.245 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-09-29T23:03:32.248 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package socat. 2023-09-29T23:03:32.266 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-09-29T23:03:32.266 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../084-socat_1.7.3.3-2_amd64.deb ... 2023-09-29T23:03:32.307 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking socat (1.7.3.3-2) ... 2023-09-29T23:03:32.336 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-09-29T23:03:32.619 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package xmlstarlet. 2023-09-29T23:03:32.636 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-09-29T23:03:32.648 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rsa. 2023-09-29T23:03:32.667 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../073-python3-rsa_4.0-3_all.deb ... 2023-09-29T23:03:32.702 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-09-29T23:03:32.705 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rsa (4.0-3) ... 2023-09-29T23:03:33.034 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-google-auth. 2023-09-29T23:03:33.040 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-test. 2023-09-29T23:03:33.054 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../074-python3-google-auth_1.5.1-2_all.deb ... 2023-09-29T23:03:33.058 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../086-ceph-test_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:33.092 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-09-29T23:03:33.098 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-test (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:33.471 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-blinker. 2023-09-29T23:03:33.490 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../075-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-09-29T23:03:33.529 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-09-29T23:03:33.865 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-oauthlib. 2023-09-29T23:03:33.883 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../076-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-09-29T23:03:33.923 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-09-29T23:03:34.277 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-09-29T23:03:34.293 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../077-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-09-29T23:03:34.360 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-09-29T23:03:34.688 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-websocket. 2023-09-29T23:03:34.704 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../078-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-09-29T23:03:34.746 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-09-29T23:03:35.107 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-kubernetes. 2023-09-29T23:03:35.127 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../079-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-09-29T23:03:35.192 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-09-29T23:03:35.729 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-09-29T23:03:35.747 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../080-ceph-mgr-k8sevents_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:03:35.812 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:36.234 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libonig5:amd64. 2023-09-29T23:03:36.252 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../081-libonig5_6.9.4-1_amd64.deb ... 2023-09-29T23:03:36.292 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-09-29T23:03:36.704 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libjq1:amd64. 2023-09-29T23:03:36.721 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../082-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-09-29T23:03:36.762 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-09-29T23:03:37.048 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package jq. 2023-09-29T23:03:37.065 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../083-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-09-29T23:03:37.106 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-09-29T23:03:37.359 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package socat. 2023-09-29T23:03:37.376 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../084-socat_1.7.3.3-2_amd64.deb ... 2023-09-29T23:03:37.409 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking socat (1.7.3.3-2) ... 2023-09-29T23:03:37.755 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package xmlstarlet. 2023-09-29T23:03:37.773 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-09-29T23:03:37.846 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-09-29T23:03:38.102 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-volume. 2023-09-29T23:03:38.121 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../087-ceph-volume_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:03:38.177 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-volume (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:38.226 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-test. 2023-09-29T23:03:38.243 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../086-ceph-test_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:38.293 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-test (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:38.490 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package fonts-mathjax. 2023-09-29T23:03:38.508 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../088-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-09-29T23:03:38.548 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-09-29T23:03:39.035 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libcephfs-dev. 2023-09-29T23:03:39.055 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../089-libcephfs-dev_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:39.094 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libcephfs-dev (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:39.530 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package nvme-cli. 2023-09-29T23:03:39.546 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-09-29T23:03:39.606 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-09-29T23:03:39.975 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libjs-mathjax. 2023-09-29T23:03:39.993 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../091-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-09-29T23:03:40.033 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-09-29T23:03:41.659 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-natsort-doc. 2023-09-29T23:03:41.678 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../092-python-natsort-doc_7.0.1-1_all.deb ... 2023-09-29T23:03:41.717 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-09-29T23:03:42.080 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-atomicwrites. 2023-09-29T23:03:42.097 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../093-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-09-29T23:03:42.138 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-09-29T23:03:42.440 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-attr. 2023-09-29T23:03:42.457 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../094-python3-attr_19.3.0-2_all.deb ... 2023-09-29T23:03:42.499 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-09-29T23:03:42.835 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-webencodings. 2023-09-29T23:03:42.855 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../095-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-09-29T23:03:42.893 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-09-29T23:03:43.164 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-volume. 2023-09-29T23:03:43.181 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../087-ceph-volume_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-29T23:03:43.212 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-html5lib. 2023-09-29T23:03:43.222 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-volume (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:43.232 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../096-python3-html5lib_1.0.1-2_all.deb ... 2023-09-29T23:03:43.270 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-09-29T23:03:43.560 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package fonts-mathjax. 2023-09-29T23:03:43.576 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../088-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-09-29T23:03:43.598 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-09-29T23:03:43.618 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-09-29T23:03:43.619 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../097-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-09-29T23:03:43.656 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-09-29T23:03:44.119 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-packaging. 2023-09-29T23:03:44.137 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../098-python3-packaging_20.3-1_all.deb ... 2023-09-29T23:03:44.164 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libcephfs-dev. 2023-09-29T23:03:44.176 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-packaging (20.3-1) ... 2023-09-29T23:03:44.181 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../089-libcephfs-dev_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:44.221 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libcephfs-dev (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:44.521 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pastescript. 2023-09-29T23:03:44.538 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-4_all.deb ... 2023-09-29T23:03:44.579 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-09-29T23:03:44.666 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package nvme-cli. 2023-09-29T23:03:44.684 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-09-29T23:03:44.742 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-09-29T23:03:44.924 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pluggy. 2023-09-29T23:03:44.941 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../100-python3-pluggy_0.13.0-2_all.deb ... 2023-09-29T23:03:44.991 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-09-29T23:03:45.142 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libjs-mathjax. 2023-09-29T23:03:45.162 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../091-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-09-29T23:03:45.205 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-09-29T23:03:45.345 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-psutil. 2023-09-29T23:03:45.361 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../101-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-09-29T23:03:45.402 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-09-29T23:03:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-py. 2023-09-29T23:03:45.751 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../102-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-09-29T23:03:45.780 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-09-29T23:03:46.083 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyinotify. 2023-09-29T23:03:46.103 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-09-29T23:03:46.141 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-09-29T23:03:46.494 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-wcwidth. 2023-09-29T23:03:46.510 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../104-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-09-29T23:03:46.552 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-09-29T23:03:46.855 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pytest. 2023-09-29T23:03:46.873 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../105-python3-pytest_4.6.9-1_all.deb ... 2023-09-29T23:03:46.913 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-09-29T23:03:47.027 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python-natsort-doc. 2023-09-29T23:03:47.046 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../092-python-natsort-doc_7.0.1-1_all.deb ... 2023-09-29T23:03:47.085 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-09-29T23:03:47.283 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-simplejson. 2023-09-29T23:03:47.301 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../106-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-09-29T23:03:47.341 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-09-29T23:03:47.497 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-atomicwrites. 2023-09-29T23:03:47.516 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../093-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-09-29T23:03:47.554 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-09-29T23:03:47.644 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-09-29T23:03:47.661 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../107-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-09-29T23:03:47.702 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-09-29T23:03:47.833 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-attr. 2023-09-29T23:03:47.851 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../094-python3-attr_19.3.0-2_all.deb ... 2023-09-29T23:03:47.891 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-09-29T23:03:48.236 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-webencodings. 2023-09-29T23:03:48.253 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../095-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-09-29T23:03:48.294 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-09-29T23:03:48.450 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package radosgw. 2023-09-29T23:03:48.465 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../108-radosgw_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:48.506 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking radosgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:48.630 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-html5lib. 2023-09-29T23:03:48.648 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../096-python3-html5lib_1.0.1-2_all.deb ... 2023-09-29T23:03:48.705 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-09-29T23:03:49.083 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-09-29T23:03:49.101 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../097-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-09-29T23:03:49.141 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-09-29T23:03:49.637 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-packaging. 2023-09-29T23:03:49.656 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../098-python3-packaging_20.3-1_all.deb ... 2023-09-29T23:03:49.695 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-packaging (20.3-1) ... 2023-09-29T23:03:50.014 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pastescript. 2023-09-29T23:03:50.028 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-4_all.deb ... 2023-09-29T23:03:50.104 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-09-29T23:03:50.277 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package rbd-fuse. 2023-09-29T23:03:50.294 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../109-rbd-fuse_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:50.335 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking rbd-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:50.451 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pluggy. 2023-09-29T23:03:50.469 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../100-python3-pluggy_0.13.0-2_all.deb ... 2023-09-29T23:03:50.509 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-09-29T23:03:50.619 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-attr (19.3.0-2) ... 2023-09-29T23:03:50.854 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-psutil. 2023-09-29T23:03:50.872 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../101-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-09-29T23:03:50.912 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-09-29T23:03:50.923 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-09-29T23:03:51.042 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-09-29T23:03:51.168 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-09-29T23:03:51.307 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-py. 2023-09-29T23:03:51.327 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../102-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-09-29T23:03:51.365 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-09-29T23:03:51.394 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:51.718 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyinotify. 2023-09-29T23:03:51.738 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-09-29T23:03:51.776 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-09-29T23:03:52.068 INFO:teuthology.orchestra.run.smithi115.stdout:Adding system user cephadm....done 2023-09-29T23:03:52.116 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-wcwidth. 2023-09-29T23:03:52.135 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../104-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-09-29T23:03:52.180 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-09-29T23:03:52.238 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-09-29T23:03:52.364 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-09-29T23:03:52.500 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pytest. 2023-09-29T23:03:52.519 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../105-python3-pytest_4.6.9-1_all.deb ... 2023-09-29T23:03:52.558 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-09-29T23:03:52.724 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-09-29T23:03:52.920 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-simplejson. 2023-09-29T23:03:52.937 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../106-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-09-29T23:03:53.011 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-09-29T23:03:53.018 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-09-29T23:03:53.145 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-09-29T23:03:53.271 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-09-29T23:03:53.297 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-09-29T23:03:53.318 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../107-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-09-29T23:03:53.356 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-09-29T23:03:53.597 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-09-29T23:03:54.028 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-09-29T23:03:54.094 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package radosgw. 2023-09-29T23:03:54.115 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../108-radosgw_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:54.185 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking radosgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:54.317 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-09-29T23:03:54.610 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-09-29T23:03:54.886 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-09-29T23:03:55.188 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-ceph-argparse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:55.489 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-09-29T23:03:55.615 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-09-29T23:03:55.924 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-09-29T23:03:56.072 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package rbd-fuse. 2023-09-29T23:03:56.089 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../109-rbd-fuse_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-29T23:03:56.130 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking rbd-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:56.242 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-09-29T23:03:56.376 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-09-29T23:03:56.472 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-attr (19.3.0-2) ... 2023-09-29T23:03:56.765 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-09-29T23:03:56.823 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-09-29T23:03:56.974 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-09-29T23:03:57.057 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-09-29T23:03:57.092 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-09-29T23:03:57.302 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:03:57.734 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-09-29T23:03:57.938 INFO:teuthology.orchestra.run.smithi156.stdout:Adding system user cephadm....done 2023-09-29T23:03:58.102 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-09-29T23:03:58.117 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-09-29T23:03:58.244 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-09-29T23:03:58.372 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-09-29T23:03:58.637 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-09-29T23:03:58.697 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-09-29T23:03:58.930 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-09-29T23:03:59.006 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-packaging (20.3-1) ... 2023-09-29T23:03:59.064 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-09-29T23:03:59.216 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-09-29T23:03:59.315 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-09-29T23:03:59.477 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-09-29T23:03:59.555 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-09-29T23:03:59.603 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-09-29T23:03:59.895 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-09-29T23:03:59.957 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-09-29T23:04:00.276 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-09-29T23:04:00.305 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-09-29T23:04:00.627 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-09-29T23:04:00.648 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-09-29T23:04:00.921 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-09-29T23:04:01.008 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up socat (1.7.3.3-2) ... 2023-09-29T23:04:01.160 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:01.229 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-ceph-argparse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:01.461 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-29T23:04:01.530 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-09-29T23:04:01.587 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-09-29T23:04:01.659 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-09-29T23:04:01.947 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-09-29T23:04:01.968 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-09-29T23:04:02.073 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-09-29T23:04:02.224 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-09-29T23:04:02.286 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-09-29T23:04:02.445 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-09-29T23:04:02.508 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-09-29T23:04:02.818 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-29T23:04:02.846 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-09-29T23:04:02.944 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-09-29T23:04:03.053 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-09-29T23:04:03.214 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-09-29T23:04:03.371 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-09-29T23:04:03.532 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-09-29T23:04:03.648 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-09-29T23:04:03.867 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-09-29T23:04:03.932 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-09-29T23:04:04.058 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-09-29T23:04:04.143 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-09-29T23:04:04.376 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-09-29T23:04:04.486 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-09-29T23:04:04.669 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-09-29T23:04:04.770 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-packaging (20.3-1) ... 2023-09-29T23:04:04.945 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-09-29T23:04:05.088 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-09-29T23:04:05.236 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-09-29T23:04:05.342 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-09-29T23:04:05.365 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-09-29T23:04:05.600 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-09-29T23:04:05.658 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-09-29T23:04:05.727 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-09-29T23:04:06.036 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-09-29T23:04:06.051 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-09-29T23:04:06.387 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-09-29T23:04:06.461 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-09-29T23:04:06.538 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-09-29T23:04:06.673 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-09-29T23:04:06.838 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up socat (1.7.3.3-2) ... 2023-09-29T23:04:06.989 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:06.990 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-09-29T23:04:07.307 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-29T23:04:07.320 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librados2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:07.442 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-09-29T23:04:07.446 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-09-29T23:04:07.844 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-09-29T23:04:07.970 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-09-29T23:04:08.119 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-09-29T23:04:08.441 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-09-29T23:04:08.751 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-29T23:04:08.869 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-09-29T23:04:08.918 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:09.028 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-09-29T23:04:09.055 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-09-29T23:04:09.181 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-09-29T23:04:09.355 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-09-29T23:04:09.566 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-09-29T23:04:09.664 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-09-29T23:04:09.858 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-09-29T23:04:09.966 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-09-29T23:04:10.086 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-09-29T23:04:10.135 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-29T23:04:10.261 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-09-29T23:04:10.405 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-09-29T23:04:10.645 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libcephfs2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:10.764 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-09-29T23:04:10.771 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-09-29T23:04:11.073 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-09-29T23:04:11.090 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libradosstriper1 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:11.215 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-09-29T23:04:11.455 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-09-29T23:04:11.542 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-09-29T23:04:11.709 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-09-29T23:04:11.827 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-09-29T23:04:12.206 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-09-29T23:04:12.574 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-09-29T23:04:12.597 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librbd1 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:12.700 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-09-29T23:04:12.723 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-09-29T23:04:12.851 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-09-29T23:04:12.858 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-09-29T23:04:12.992 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-09-29T23:04:13.152 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rsa (4.0-3) ... 2023-09-29T23:04:13.177 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-09-29T23:04:13.453 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-09-29T23:04:13.453 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librados2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:13.579 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-09-29T23:04:13.580 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-09-29T23:04:13.913 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-modules-core (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:14.039 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:14.266 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-29T23:04:14.266 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-29T23:04:14.774 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libcephfs-dev (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:15.011 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-09-29T23:04:15.114 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:15.238 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-09-29T23:04:15.385 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-09-29T23:04:15.646 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-09-29T23:04:15.774 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-09-29T23:04:15.965 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-09-29T23:04:16.083 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-09-29T23:04:16.325 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rados (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:16.368 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-29T23:04:16.468 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librgw2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:16.477 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-09-29T23:04:16.578 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rbd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:16.704 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up rbd-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:16.830 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-routes (2.4.1-2) ... 2023-09-29T23:04:16.870 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libcephfs2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:16.996 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-09-29T23:04:17.156 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-09-29T23:04:17.331 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libradosstriper1 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:17.482 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-09-29T23:04:17.491 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:17.625 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cephfs (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:17.760 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-09-29T23:04:17.833 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-09-29T23:04:18.671 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:18.897 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librbd1 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:19.023 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-09-29T23:04:19.182 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-09-29T23:04:19.216 INFO:teuthology.orchestra.run.smithi115.stdout:Adding group ceph....done 2023-09-29T23:04:19.308 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-09-29T23:04:19.467 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rsa (4.0-3) ... 2023-09-29T23:04:19.584 INFO:teuthology.orchestra.run.smithi115.stdout:Adding system user ceph....done 2023-09-29T23:04:19.752 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-09-29T23:04:19.768 INFO:teuthology.orchestra.run.smithi115.stdout:Setting system user ceph properties....done 2023-09-29T23:04:19.788 INFO:teuthology.orchestra.run.smithi115.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-09-29T23:04:19.869 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-09-29T23:04:19.934 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-09-29T23:04:20.162 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-modules-core (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:20.253 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-09-29T23:04:20.321 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:20.546 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-29T23:04:20.546 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-29T23:04:20.731 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-test (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:20.857 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up radosgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:21.022 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libcephfs-dev (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:21.139 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-29T23:04:21.139 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-29T23:04:21.267 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-09-29T23:04:21.552 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-09-29T23:04:21.826 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-base (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:21.870 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-09-29T23:04:22.201 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-09-29T23:04:22.231 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rados (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:22.390 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librgw2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:22.516 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rbd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:22.661 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mds (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:22.684 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up rbd-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:22.802 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-routes (2.4.1-2) ... 2023-09-29T23:04:22.878 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-29T23:04:22.878 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-29T23:04:23.158 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-09-29T23:04:23.321 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:23.480 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:23.550 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-29T23:04:23.551 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-29T23:04:23.605 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cephfs (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:23.756 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-09-29T23:04:24.006 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-osd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:24.501 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-29T23:04:24.501 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-29T23:04:24.701 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:24.949 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:25.092 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:25.226 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mon (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:25.303 INFO:teuthology.orchestra.run.smithi156.stdout:Adding group ceph....done 2023-09-29T23:04:25.448 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-29T23:04:25.448 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-29T23:04:25.681 INFO:teuthology.orchestra.run.smithi156.stdout:Adding system user ceph....done 2023-09-29T23:04:25.886 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:25.907 INFO:teuthology.orchestra.run.smithi156.stdout:Setting system user ceph properties....done 2023-09-29T23:04:25.930 INFO:teuthology.orchestra.run.smithi156.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-09-29T23:04:26.028 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:26.075 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-09-29T23:04:26.180 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-dashboard (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:26.325 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-volume (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:26.382 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-09-29T23:04:26.444 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-09-29T23:04:26.596 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-09-29T23:04:26.862 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-test (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:26.880 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-09-29T23:04:27.029 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up radosgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:27.300 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-29T23:04:27.301 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-29T23:04:27.975 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-base (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:28.377 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-09-29T23:04:28.844 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mds (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:29.094 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-29T23:04:29.094 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-29T23:04:29.546 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:29.770 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-29T23:04:29.770 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-29T23:04:29.800 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-09-29T23:04:30.230 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-osd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:30.400 INFO:teuthology.orchestra.run.smithi115.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-29T23:04:30.403 DEBUG:teuthology.parallel:result is None 2023-09-29T23:04:30.756 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-29T23:04:30.756 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-29T23:04:31.240 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:31.366 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:31.905 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mon (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:32.214 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-29T23:04:32.214 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-29T23:04:32.688 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:32.837 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:32.983 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-dashboard (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:33.131 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-volume (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-29T23:04:33.271 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-09-29T23:04:33.428 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-09-29T23:04:33.721 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-09-29T23:04:36.582 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-09-29T23:04:37.186 INFO:teuthology.orchestra.run.smithi156.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-29T23:04:37.189 DEBUG:teuthology.parallel:result is None 2023-09-29T23:04:37.189 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=93dce5e17918f8aca65993a7a2dc40233a47b481 2023-09-29T23:04:37.337 DEBUG:teuthology.orchestra.run.smithi115:> dpkg-query -W -f '${Version}' ceph 2023-09-29T23:04:37.362 INFO:teuthology.orchestra.run.smithi115.stdout:17.2.6-1165-g93dce5e1-1focal 2023-09-29T23:04:37.362 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1165-g93dce5e1-1focal 2023-09-29T23:04:37.362 INFO:teuthology.task.install:The correct ceph version 17.2.6-1165-g93dce5e1-1focal is installed. 2023-09-29T23:04:37.363 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=93dce5e17918f8aca65993a7a2dc40233a47b481 2023-09-29T23:04:37.582 DEBUG:teuthology.orchestra.run.smithi156:> dpkg-query -W -f '${Version}' ceph 2023-09-29T23:04:37.606 INFO:teuthology.orchestra.run.smithi156.stdout:17.2.6-1165-g93dce5e1-1focal 2023-09-29T23:04:37.606 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1165-g93dce5e1-1focal 2023-09-29T23:04:37.606 INFO:teuthology.task.install:The correct ceph version 17.2.6-1165-g93dce5e1-1focal is installed. 2023-09-29T23:04:37.607 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-29T23:04:37.607 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:37.607 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-29T23:04:37.624 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:37.624 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-29T23:04:37.664 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-29T23:04:37.665 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:37.665 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2023-09-29T23:04:37.681 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-29T23:04:37.691 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:37.692 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2023-09-29T23:04:37.705 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-29T23:04:37.715 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-29T23:04:37.715 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:37.716 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-29T23:04:37.731 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-29T23:04:37.789 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:37.789 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-29T23:04:37.805 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-29T23:04:37.815 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-29T23:04:37.815 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:37.815 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2023-09-29T23:04:37.830 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-29T23:04:37.886 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:37.886 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2023-09-29T23:04:37.902 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-29T23:04:37.960 INFO:teuthology.run_tasks:Running task ceph... 2023-09-29T23:04:38.028 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-29T23:04:38.029 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2023-09-29T23:04:38.031 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /var/log/ceph 2023-09-29T23:04:38.046 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-29T23:04:38.047 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-29T23:04:38.049 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-29T23:04:38.059 INFO:tasks.ceph:Creating extra log directories... 2023-09-29T23:04:38.059 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-29T23:04:38.099 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-29T23:04:38.120 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-29T23:04:38.120 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-29T23:04:38.120 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-29T23:04:38.120 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:38.120 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-29T23:04:38.125 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-29T23:04:38.163 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:38.163 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-29T23:04:38.169 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-29T23:04:38.254 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-29T23:04:38.254 INFO:tasks.ceph:config {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 1}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 0}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(RECENT_CRASH\\)', 'replacing it with standby', 'No standby daemons available', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-29T23:04:38.254 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519', 'branch': 'wip-yuri4-testing-2023-09-29-0928-quincy', 'description': 'rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{ubuntu_latest} tasks/crash}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7406519', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 2, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2023-09-29-0928-quincy'}, 'ceph': {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 1}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 0}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'filestore': True, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'}}, 'workunit': {'branch': 'wip-yuri4-testing-2023-09-29-0928-quincy', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mgr.x', 'mon.a', 'mon.c', 'mds.a', 'mds.c', 'osd.0', 'client.0'], ['mgr.y', 'mgr.z', 'mon.b', 'mds.b', 'osd.1', 'osd.2', 'osd.3', 'client.1']], 'seed': 9810, 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri4-testing-2023-09-29-0928-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481', 'targets': {'smithi115.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi156.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(RECENT_CRASH\\)', 'replacing it with standby', 'No standby daemons available', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'wait-for-scrub': False, 'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 1}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 0}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481', 'cluster': 'ceph'}}, {'cephfs_test_runner': {'modules': ['tasks.mgr.test_crash']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-29_19:38:56', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-29T23:04:38.255 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-29T23:04:38.257 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-29T23:04:38.263 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2023-09-29T23:04:38.265 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/run/ceph 2023-09-29T23:04:38.280 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:38.280 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2023-09-29T23:04:38.286 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-29T23:04:38.286 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2023-09-29T23:04:38.336 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-29T23:04:38.336 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-29T23:04:38.336 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 356 Links: 1 2023-09-29T23:04:38.336 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-29T23:04:38.336 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-09-29 23:00:48.333946848 +0000 2023-09-29T23:04:38.336 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-09-29 23:00:48.329946940 +0000 2023-09-29T23:04:38.336 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-09-29 23:00:48.329946940 +0000 2023-09-29T23:04:38.337 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2023-09-29T23:04:38.337 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-29T23:04:38.347 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-09-29T23:04:38.348 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-09-29T23:04:38.348 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.00042778 s, 1.2 MB/s 2023-09-29T23:04:38.349 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-29T23:04:38.358 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2023-09-29T23:04:38.412 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-29T23:04:38.412 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-29T23:04:38.413 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 362 Links: 1 2023-09-29T23:04:38.413 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-29T23:04:38.413 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-09-29 23:00:49.157927847 +0000 2023-09-29T23:04:38.413 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-09-29 23:00:48.861934673 +0000 2023-09-29T23:04:38.413 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-09-29 23:00:48.861934673 +0000 2023-09-29T23:04:38.413 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2023-09-29T23:04:38.413 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-29T23:04:38.424 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-09-29T23:04:38.424 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-09-29T23:04:38.424 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000388538 s, 1.3 MB/s 2023-09-29T23:04:38.425 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-29T23:04:38.433 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2023-09-29T23:04:38.483 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-29T23:04:38.484 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-29T23:04:38.484 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 372 Links: 1 2023-09-29T23:04:38.484 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-29T23:04:38.484 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-09-29 23:00:49.697915394 +0000 2023-09-29T23:04:38.484 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-09-29 23:00:49.397922310 +0000 2023-09-29T23:04:38.484 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-09-29 23:00:49.397922310 +0000 2023-09-29T23:04:38.484 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2023-09-29T23:04:38.484 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-29T23:04:38.499 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-09-29T23:04:38.499 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-09-29T23:04:38.500 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000394638 s, 1.3 MB/s 2023-09-29T23:04:38.501 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-29T23:04:38.510 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2023-09-29T23:04:38.560 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-29T23:04:38.560 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-29T23:04:38.560 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 375 Links: 1 2023-09-29T23:04:38.560 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-29T23:04:38.560 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-09-29 23:00:49.913910408 +0000 2023-09-29T23:04:38.560 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-09-29 23:00:49.909910502 +0000 2023-09-29T23:04:38.560 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-09-29 23:00:49.909910502 +0000 2023-09-29T23:04:38.560 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2023-09-29T23:04:38.561 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-29T23:04:38.571 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-09-29T23:04:38.571 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-09-29T23:04:38.572 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000413764 s, 1.2 MB/s 2023-09-29T23:04:38.573 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-29T23:04:38.580 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-09-29T23:04:38.580 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:38.580 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2023-09-29T23:04:38.587 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-29T23:04:38.587 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2023-09-29T23:04:38.595 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-29T23:04:38.595 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-29T23:04:38.595 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 359 Links: 1 2023-09-29T23:04:38.595 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-29T23:04:38.595 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-09-29 23:00:50.417914236 +0000 2023-09-29T23:04:38.595 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-09-29 23:00:50.413913880 +0000 2023-09-29T23:04:38.595 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-09-29 23:00:50.413913880 +0000 2023-09-29T23:04:38.595 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-09-29T23:04:38.595 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-29T23:04:38.607 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-09-29T23:04:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-09-29T23:04:38.608 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000300914 s, 1.7 MB/s 2023-09-29T23:04:38.609 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-29T23:04:38.661 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2023-09-29T23:04:38.669 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-29T23:04:38.669 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-29T23:04:38.669 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-09-29T23:04:38.669 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-29T23:04:38.669 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-09-29 23:00:51.269988962 +0000 2023-09-29T23:04:38.669 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-09-29 23:00:50.973963692 +0000 2023-09-29T23:04:38.670 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-09-29 23:00:50.973963692 +0000 2023-09-29T23:04:38.670 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-09-29T23:04:38.670 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-29T23:04:38.729 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-09-29T23:04:38.729 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-09-29T23:04:38.729 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000300937 s, 1.7 MB/s 2023-09-29T23:04:38.730 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-29T23:04:38.739 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2023-09-29T23:04:38.746 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-29T23:04:38.746 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-29T23:04:38.746 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 371 Links: 1 2023-09-29T23:04:38.747 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-29T23:04:38.747 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-09-29 23:00:51.742029057 +0000 2023-09-29T23:04:38.747 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-09-29 23:00:51.494007990 +0000 2023-09-29T23:04:38.747 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-09-29 23:00:51.494007990 +0000 2023-09-29T23:04:38.747 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-09-29T23:04:38.747 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-29T23:04:38.760 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-09-29T23:04:38.761 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-09-29T23:04:38.761 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.00029353 s, 1.7 MB/s 2023-09-29T23:04:38.762 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-29T23:04:38.817 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2023-09-29T23:04:38.824 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-29T23:04:38.824 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-29T23:04:38.824 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-09-29T23:04:38.825 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-29T23:04:38.825 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-09-29 23:00:52.246071149 +0000 2023-09-29T23:04:38.825 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-09-29 23:00:51.978049107 +0000 2023-09-29T23:04:38.825 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-09-29 23:00:51.978049107 +0000 2023-09-29T23:04:38.825 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-09-29T23:04:38.825 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-29T23:04:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-09-29T23:04:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-09-29T23:04:38.837 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000268714 s, 1.9 MB/s 2023-09-29T23:04:38.838 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-29T23:04:38.847 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-09-29T23:04:38.847 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2023-09-29T23:04:38.847 INFO:tasks.ceph:Generating config... 2023-09-29T23:04:38.848 INFO:tasks.ceph:[client] debug client = 20 2023-09-29T23:04:38.848 INFO:tasks.ceph:[client] debug mgrc = 20 2023-09-29T23:04:38.848 INFO:tasks.ceph:[client] debug ms = 1 2023-09-29T23:04:38.848 INFO:tasks.ceph:[global] mon election default strategy = 1 2023-09-29T23:04:38.848 INFO:tasks.ceph:[mds] debug mgrc = 20 2023-09-29T23:04:38.848 INFO:tasks.ceph:[mgr] debug client = 20 2023-09-29T23:04:38.848 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-29T23:04:38.849 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-29T23:04:38.849 INFO:tasks.ceph:[mgr] mgr ttl cache expire seconds = 0 2023-09-29T23:04:38.849 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-29T23:04:38.849 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-29T23:04:38.849 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-29T23:04:38.849 INFO:tasks.ceph:[osd] debug mgrc = 20 2023-09-29T23:04:38.849 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-29T23:04:38.849 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-29T23:04:38.849 INFO:tasks.ceph:[osd] osd objectstore = filestore 2023-09-29T23:04:38.849 INFO:tasks.ceph:[osd] osd sloppy crc = True 2023-09-29T23:04:38.849 INFO:tasks.ceph:Setting up mon.a... 2023-09-29T23:04:38.850 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-29T23:04:38.886 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.keyring 2023-09-29T23:04:38.889 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-29T23:04:38.921 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-29T23:04:38.979 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.115'), ('mon.c', '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]'), ('mon.b', '172.21.15.156')] 2023-09-29T23:04:38.979 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790],172.21.15.156', 'mon election default strategy': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'mgr ttl cache expire seconds': 0}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mgrc': 20}} 2023-09-29T23:04:38.980 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:38.980 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-29T23:04:38.986 DEBUG:teuthology.orchestra.run.smithi115:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.115 --addv c '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]' --add b 172.21.15.156 --print /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:04:39.023 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:04:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool: generated fsid 593687ae-01c7-4a32-a91e-931db75fb751 2023-09-29T23:04:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:setting min_mon_release = octopus 2023-09-29T23:04:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 0 2023-09-29T23:04:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:fsid 593687ae-01c7-4a32-a91e-931db75fb751 2023-09-29T23:04:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:last_changed 2023-09-29T23:04:39.024127+0000 2023-09-29T23:04:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:created 2023-09-29T23:04:39.024127+0000 2023-09-29T23:04:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:min_mon_release 15 (octopus) 2023-09-29T23:04:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:election_strategy: 1 2023-09-29T23:04:39.024 INFO:teuthology.orchestra.run.smithi115.stdout:0: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.a 2023-09-29T23:04:39.025 INFO:teuthology.orchestra.run.smithi115.stdout:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-09-29T23:04:39.025 INFO:teuthology.orchestra.run.smithi115.stdout:2: [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] mon.c 2023-09-29T23:04:39.025 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-29T23:04:39.026 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-29T23:04:39.030 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 593687ae-01c7-4a32-a91e-931db75fb751... 2023-09-29T23:04:39.031 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-29T23:04:39.075 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-29T23:04:39.109 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2023-09-29T23:04:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: chdir = "" 2023-09-29T23:04:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-29T23:04:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: auth supported = cephx 2023-09-29T23:04:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: filestore xattr use omap = true 2023-09-29T23:04:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: mon clock drift allowed = 1.000 2023-09-29T23:04:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: osd crush chooseleaf type = 0 2023-09-29T23:04:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: auth debug = true 2023-09-29T23:04:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on old message = true 2023-09-29T23:04:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on bug = true 2023-09-29T23:04:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-29T23:04:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: mon pg warn max object skew = 0 2023-09-29T23:04:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: # disable pg_autoscaler by default for new pools 2023-09-29T23:04:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-29T23:04:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default size = 2 2023-09-29T23:04:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow primary affinity = true 2023-09-29T23:04:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow pg remap = true 2023-09-29T23:04:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on legacy crush tunables = false 2023-09-29T23:04:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on crush straw calc version zero = false 2023-09-29T23:04:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on no sortbitwise = false 2023-09-29T23:04:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on osd down out interval zero = false 2023-09-29T23:04:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on too few osds = false 2023-09-29T23:04:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-29T23:04:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-29T23:04:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: mon_allow_pool_size_one = true 2023-09-29T23:04:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-29T23:04:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: osd default data pool replay window = 5 2023-09-29T23:04:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: mon allow pool delete = true 2023-09-29T23:04:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: mon cluster log file level = debug 2023-09-29T23:04:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: debug asserts on shutdown = true 2023-09-29T23:04:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: mon health detail to clog = false 2023-09-29T23:04:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: mon host = "172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790],172.21.15.156" 2023-09-29T23:04:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: mon election default strategy = 1 2023-09-29T23:04:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = 593687ae-01c7-4a32-a91e-931db75fb751 2023-09-29T23:04:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.114 INFO:teuthology.orchestra.run.smithi115.stdout:[osd] 2023-09-29T23:04:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: osd journal size = 100 2023-09-29T23:04:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub load threshold = 5.0 2023-09-29T23:04:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub max interval = 600 2023-09-29T23:04:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: osd mclock profile = high_recovery_ops 2023-09-29T23:04:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: osd recover clone overlap = true 2023-09-29T23:04:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: osd recovery max chunk = 1048576 2023-09-29T23:04:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug shutdown = true 2023-09-29T23:04:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug op order = true 2023-09-29T23:04:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug verify stray on activate = true 2023-09-29T23:04:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: osd open classes on start = true 2023-09-29T23:04:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug pg log writeout = true 2023-09-29T23:04:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: osd deep scrub update digest min age = 30 2023-09-29T23:04:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: osd map max advance = 10 2023-09-29T23:04:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: journal zero on create = true 2023-09-29T23:04:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: filestore ondisk finisher threads = 3 2023-09-29T23:04:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: filestore apply finisher threads = 3 2023-09-29T23:04:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: bdev debug aio = true 2023-09-29T23:04:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug misdirected ops = true 2023-09-29T23:04:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgrc = 20 2023-09-29T23:04:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-09-29T23:04:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: debug osd = 20 2023-09-29T23:04:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: osd objectstore = filestore 2023-09-29T23:04:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: osd sloppy crc = True 2023-09-29T23:04:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.117 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr] 2023-09-29T23:04:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-09-29T23:04:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgr = 20 2023-09-29T23:04:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2023-09-29T23:04:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2023-09-29T23:04:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2023-09-29T23:04:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2023-09-29T23:04:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: mgr/telemetry/nag = false 2023-09-29T23:04:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2023-09-29T23:04:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: mgr ttl cache expire seconds = 0 2023-09-29T23:04:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.118 INFO:teuthology.orchestra.run.smithi115.stdout:[mon] 2023-09-29T23:04:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-09-29T23:04:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2023-09-29T23:04:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: debug paxos = 20 2023-09-29T23:04:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2023-09-29T23:04:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: mon data avail warn = 5 2023-09-29T23:04:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: mon mgr mkfs grace = 240 2023-09-29T23:04:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2023-09-29T23:04:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd reporter subtree level = osd 2023-09-29T23:04:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd prime pg temp = true 2023-09-29T23:04:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2023-09-29T23:04:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-29T23:04:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: auth mon ticket ttl = 660 # 11m 2023-09-29T23:04:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: auth service ticket ttl = 240 # 4m 2023-09-29T23:04:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: # don't complain about insecure global_id in the test suite 2023-09-29T23:04:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-29T23:04:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-29T23:04:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: # 1m isn't quite enough 2023-09-29T23:04:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: mon_down_mkfs_grace = 2m 2023-09-29T23:04:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_filestore_osds = false 2023-09-29T23:04:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:39.121 INFO:teuthology.orchestra.run.smithi115.stdout:[client] 2023-09-29T23:04:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: rgw cache enabled = true 2023-09-29T23:04:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable ops log = true 2023-09-29T23:04:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable usage log = true 2023-09-29T23:04:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-29T23:04:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-29T23:04:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2023-09-29T23:04:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgrc = 20 2023-09-29T23:04:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-09-29T23:04:39.121 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.a] 2023-09-29T23:04:39.121 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.c] 2023-09-29T23:04:39.121 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.b] 2023-09-29T23:04:39.121 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2023-09-29T23:04:39.122 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2023-09-29T23:04:39.122 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2023-09-29T23:04:39.122 INFO:teuthology.orchestra.run.smithi115.stdout:[mds] 2023-09-29T23:04:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgrc = 20 2023-09-29T23:04:39.123 INFO:teuthology.orchestra.run.smithi156.stdout:[global] 2023-09-29T23:04:39.123 INFO:teuthology.orchestra.run.smithi156.stdout: chdir = "" 2023-09-29T23:04:39.124 INFO:teuthology.orchestra.run.smithi156.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-29T23:04:39.124 INFO:teuthology.orchestra.run.smithi156.stdout: auth supported = cephx 2023-09-29T23:04:39.124 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.124 INFO:teuthology.orchestra.run.smithi156.stdout: filestore xattr use omap = true 2023-09-29T23:04:39.124 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.124 INFO:teuthology.orchestra.run.smithi156.stdout: mon clock drift allowed = 1.000 2023-09-29T23:04:39.124 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.124 INFO:teuthology.orchestra.run.smithi156.stdout: osd crush chooseleaf type = 0 2023-09-29T23:04:39.124 INFO:teuthology.orchestra.run.smithi156.stdout: auth debug = true 2023-09-29T23:04:39.124 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.124 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on old message = true 2023-09-29T23:04:39.124 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on bug = true 2023-09-29T23:04:39.125 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.129 INFO:teuthology.orchestra.run.smithi156.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-29T23:04:39.129 INFO:teuthology.orchestra.run.smithi156.stdout: mon pg warn max object skew = 0 2023-09-29T23:04:39.129 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.129 INFO:teuthology.orchestra.run.smithi156.stdout: # disable pg_autoscaler by default for new pools 2023-09-29T23:04:39.129 INFO:teuthology.orchestra.run.smithi156.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-29T23:04:39.129 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.129 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default size = 2 2023-09-29T23:04:39.129 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.129 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow primary affinity = true 2023-09-29T23:04:39.130 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow pg remap = true 2023-09-29T23:04:39.130 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on legacy crush tunables = false 2023-09-29T23:04:39.130 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on crush straw calc version zero = false 2023-09-29T23:04:39.130 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on no sortbitwise = false 2023-09-29T23:04:39.130 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on osd down out interval zero = false 2023-09-29T23:04:39.130 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on too few osds = false 2023-09-29T23:04:39.130 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-29T23:04:39.130 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-29T23:04:39.130 INFO:teuthology.orchestra.run.smithi156.stdout: mon_allow_pool_size_one = true 2023-09-29T23:04:39.130 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.130 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-29T23:04:39.130 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.131 INFO:teuthology.orchestra.run.smithi156.stdout: osd default data pool replay window = 5 2023-09-29T23:04:39.131 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.131 INFO:teuthology.orchestra.run.smithi156.stdout: mon allow pool delete = true 2023-09-29T23:04:39.131 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.131 INFO:teuthology.orchestra.run.smithi156.stdout: mon cluster log file level = debug 2023-09-29T23:04:39.131 INFO:teuthology.orchestra.run.smithi156.stdout: debug asserts on shutdown = true 2023-09-29T23:04:39.131 INFO:teuthology.orchestra.run.smithi156.stdout: mon health detail to clog = false 2023-09-29T23:04:39.131 INFO:teuthology.orchestra.run.smithi156.stdout: mon host = "172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790],172.21.15.156" 2023-09-29T23:04:39.131 INFO:teuthology.orchestra.run.smithi156.stdout: mon election default strategy = 1 2023-09-29T23:04:39.131 INFO:teuthology.orchestra.run.smithi156.stdout: fsid = 593687ae-01c7-4a32-a91e-931db75fb751 2023-09-29T23:04:39.131 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.131 INFO:teuthology.orchestra.run.smithi156.stdout:[osd] 2023-09-29T23:04:39.131 INFO:teuthology.orchestra.run.smithi156.stdout: osd journal size = 100 2023-09-29T23:04:39.132 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.132 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub load threshold = 5.0 2023-09-29T23:04:39.132 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub max interval = 600 2023-09-29T23:04:39.132 INFO:teuthology.orchestra.run.smithi156.stdout: osd mclock profile = high_recovery_ops 2023-09-29T23:04:39.132 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.132 INFO:teuthology.orchestra.run.smithi156.stdout: osd recover clone overlap = true 2023-09-29T23:04:39.132 INFO:teuthology.orchestra.run.smithi156.stdout: osd recovery max chunk = 1048576 2023-09-29T23:04:39.132 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.132 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug shutdown = true 2023-09-29T23:04:39.132 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug op order = true 2023-09-29T23:04:39.132 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug verify stray on activate = true 2023-09-29T23:04:39.132 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.132 INFO:teuthology.orchestra.run.smithi156.stdout: osd open classes on start = true 2023-09-29T23:04:39.133 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug pg log writeout = true 2023-09-29T23:04:39.133 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.133 INFO:teuthology.orchestra.run.smithi156.stdout: osd deep scrub update digest min age = 30 2023-09-29T23:04:39.133 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.133 INFO:teuthology.orchestra.run.smithi156.stdout: osd map max advance = 10 2023-09-29T23:04:39.133 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.133 INFO:teuthology.orchestra.run.smithi156.stdout: journal zero on create = true 2023-09-29T23:04:39.133 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.133 INFO:teuthology.orchestra.run.smithi156.stdout: filestore ondisk finisher threads = 3 2023-09-29T23:04:39.133 INFO:teuthology.orchestra.run.smithi156.stdout: filestore apply finisher threads = 3 2023-09-29T23:04:39.133 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.133 INFO:teuthology.orchestra.run.smithi156.stdout: bdev debug aio = true 2023-09-29T23:04:39.134 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug misdirected ops = true 2023-09-29T23:04:39.134 INFO:teuthology.orchestra.run.smithi156.stdout: debug mgrc = 20 2023-09-29T23:04:39.134 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-09-29T23:04:39.134 INFO:teuthology.orchestra.run.smithi156.stdout: debug osd = 20 2023-09-29T23:04:39.134 INFO:teuthology.orchestra.run.smithi156.stdout: osd objectstore = filestore 2023-09-29T23:04:39.134 INFO:teuthology.orchestra.run.smithi156.stdout: osd sloppy crc = True 2023-09-29T23:04:39.134 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.134 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr] 2023-09-29T23:04:39.134 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-09-29T23:04:39.134 INFO:teuthology.orchestra.run.smithi156.stdout: debug mgr = 20 2023-09-29T23:04:39.134 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2023-09-29T23:04:39.134 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2023-09-29T23:04:39.134 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2023-09-29T23:04:39.135 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2023-09-29T23:04:39.135 INFO:teuthology.orchestra.run.smithi156.stdout: mgr/telemetry/nag = false 2023-09-29T23:04:39.135 INFO:teuthology.orchestra.run.smithi156.stdout: debug client = 20 2023-09-29T23:04:39.135 INFO:teuthology.orchestra.run.smithi156.stdout: mgr ttl cache expire seconds = 0 2023-09-29T23:04:39.135 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.135 INFO:teuthology.orchestra.run.smithi156.stdout:[mon] 2023-09-29T23:04:39.135 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-09-29T23:04:39.135 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2023-09-29T23:04:39.135 INFO:teuthology.orchestra.run.smithi156.stdout: debug paxos = 20 2023-09-29T23:04:39.135 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2023-09-29T23:04:39.135 INFO:teuthology.orchestra.run.smithi156.stdout: mon data avail warn = 5 2023-09-29T23:04:39.135 INFO:teuthology.orchestra.run.smithi156.stdout: mon mgr mkfs grace = 240 2023-09-29T23:04:39.135 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2023-09-29T23:04:39.136 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd reporter subtree level = osd 2023-09-29T23:04:39.136 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd prime pg temp = true 2023-09-29T23:04:39.136 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2023-09-29T23:04:39.136 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.136 INFO:teuthology.orchestra.run.smithi156.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-29T23:04:39.136 INFO:teuthology.orchestra.run.smithi156.stdout: auth mon ticket ttl = 660 # 11m 2023-09-29T23:04:39.136 INFO:teuthology.orchestra.run.smithi156.stdout: auth service ticket ttl = 240 # 4m 2023-09-29T23:04:39.136 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.136 INFO:teuthology.orchestra.run.smithi156.stdout: # don't complain about insecure global_id in the test suite 2023-09-29T23:04:39.136 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-29T23:04:39.136 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-29T23:04:39.136 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.136 INFO:teuthology.orchestra.run.smithi156.stdout: # 1m isn't quite enough 2023-09-29T23:04:39.137 INFO:teuthology.orchestra.run.smithi156.stdout: mon_down_mkfs_grace = 2m 2023-09-29T23:04:39.137 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.137 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_filestore_osds = false 2023-09-29T23:04:39.137 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-29T23:04:39.137 INFO:teuthology.orchestra.run.smithi156.stdout:[client] 2023-09-29T23:04:39.137 INFO:teuthology.orchestra.run.smithi156.stdout: rgw cache enabled = true 2023-09-29T23:04:39.137 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable ops log = true 2023-09-29T23:04:39.137 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable usage log = true 2023-09-29T23:04:39.137 INFO:teuthology.orchestra.run.smithi156.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-29T23:04:39.137 INFO:teuthology.orchestra.run.smithi156.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-29T23:04:39.137 INFO:teuthology.orchestra.run.smithi156.stdout: debug client = 20 2023-09-29T23:04:39.137 INFO:teuthology.orchestra.run.smithi156.stdout: debug mgrc = 20 2023-09-29T23:04:39.138 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-09-29T23:04:39.138 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.a] 2023-09-29T23:04:39.138 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.c] 2023-09-29T23:04:39.138 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.b] 2023-09-29T23:04:39.138 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2023-09-29T23:04:39.138 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.c] 2023-09-29T23:04:39.138 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.b] 2023-09-29T23:04:39.138 INFO:teuthology.orchestra.run.smithi156.stdout:[mds] 2023-09-29T23:04:39.138 INFO:teuthology.orchestra.run.smithi156.stdout: debug mgrc = 20 2023-09-29T23:04:39.138 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-29T23:04:39.139 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-29T23:04:39.188 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-29T23:04:39.188 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:39.188 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-29T23:04:39.195 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:39.195 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-29T23:04:39.202 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2023-09-29T23:04:39.202 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:39.203 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-29T23:04:39.203 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-29T23:04:39.227 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:39.227 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:04:39.276 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi156.front.sepia.ceph.com 2023-09-29T23:04:39.276 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:39.276 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-29T23:04:39.276 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-29T23:04:39.304 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:39.309 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:04:39.315 INFO:tasks.ceph:Setting up mon nodes... 2023-09-29T23:04:39.315 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-29T23:04:39.315 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-29T23:04:39.362 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-29T23:04:39.365 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-29T23:04:39.409 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-29T23:04:39.412 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2023-09-29T23:04:39.454 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2023-09-29T23:04:39.456 INFO:tasks.ceph:Setting up mds nodes... 2023-09-29T23:04:39.456 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-29T23:04:39.504 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-29T23:04:39.507 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-29T23:04:39.522 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-09-29T23:04:39.562 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-09-29T23:04:39.565 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-09-29T23:04:39.578 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-29T23:04:39.620 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-29T23:04:39.622 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-29T23:04:39.680 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-29T23:04:39.681 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-29T23:04:39.718 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-29T23:04:39.730 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-09-29T23:04:39.769 INFO:teuthology.orchestra.run.smithi156.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-09-29T23:04:39.781 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-29T23:04:39.781 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2023-09-29T23:04:39.781 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-29T23:04:39.797 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-09-29T23:04:39.797 INFO:tasks.ceph:role: osd.0 2023-09-29T23:04:39.797 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2023-09-29T23:04:39.797 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-29T23:04:40.314 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-29T23:04:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-29T23:04:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-29T23:04:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 2023-09-29T23:04:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-29T23:04:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-09-29T23:04:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-29T23:04:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-29T23:04:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-29T23:04:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-29T23:04:40.316 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-09-29T23:04:40.317 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-29T23:04:40.401 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-29T23:04:40.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-29T23:04:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2023-09-29T23:04:40.414 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:04:40.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:40.478+0000 7fb975c973c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-29T23:04:40.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:40.478+0000 7fb975c973c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-29T23:04:40.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:40.518+0000 7fb975c973c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-09-29T23:04:40.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:40.518+0000 7fb975c973c0 -1 journal FileJournal::_open_file : zeroing journal 2023-09-29T23:04:40.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:40.778+0000 7fb975c973c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-09-29T23:04:40.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:40.778+0000 7fb975c973c0 -1 journal do_read_entry(4096): bad header magic 2023-09-29T23:04:40.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:40.778+0000 7fb975c973c0 -1 journal do_read_entry(4096): bad header magic 2023-09-29T23:04:40.812 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-29T23:04:40.826 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-29T23:04:40.843 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-09-29T23:04:40.843 INFO:tasks.ceph:role: osd.1 2023-09-29T23:04:40.843 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-29T23:04:40.843 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-29T23:04:40.927 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-29T23:04:40.928 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-29T23:04:40.928 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-29T23:04:40.928 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 2023-09-29T23:04:40.928 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-29T23:04:40.928 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-09-29T23:04:40.928 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-29T23:04:40.928 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-29T23:04:40.928 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-29T23:04:40.928 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-29T23:04:40.929 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-09-29T23:04:40.930 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-09-29T23:04:40.951 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-29T23:04:40.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-29T23:04:40.958 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: /sbin/restorecon: command not found 2023-09-29T23:04:40.959 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-29T23:04:40.970 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-09-29T23:04:40.970 INFO:tasks.ceph:role: osd.2 2023-09-29T23:04:40.970 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-29T23:04:40.970 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-29T23:04:41.010 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-29T23:04:41.010 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-29T23:04:41.011 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-29T23:04:41.011 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 2023-09-29T23:04:41.011 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-29T23:04:41.011 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-09-29T23:04:41.011 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-29T23:04:41.011 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-29T23:04:41.011 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-29T23:04:41.011 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-29T23:04:41.012 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-09-29T23:04:41.012 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2023-09-29T23:04:41.074 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-29T23:04:41.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-29T23:04:41.083 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: /sbin/restorecon: command not found 2023-09-29T23:04:41.083 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-29T23:04:41.095 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-09-29T23:04:41.095 INFO:tasks.ceph:role: osd.3 2023-09-29T23:04:41.096 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-29T23:04:41.096 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-29T23:04:41.180 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-29T23:04:41.180 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-29T23:04:41.180 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-29T23:04:41.180 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 2023-09-29T23:04:41.180 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-29T23:04:41.180 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-09-29T23:04:41.180 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-29T23:04:41.180 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-29T23:04:41.181 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-29T23:04:41.181 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-29T23:04:41.181 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-09-29T23:04:41.182 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2023-09-29T23:04:41.201 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-29T23:04:41.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-29T23:04:41.208 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: /sbin/restorecon: command not found 2023-09-29T23:04:41.208 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:04:41.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.272+0000 7f04557363c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-29T23:04:41.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.272+0000 7f04557363c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-29T23:04:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.288+0000 7f04557363c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-09-29T23:04:41.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.288+0000 7f04557363c0 -1 journal FileJournal::_open_file : zeroing journal 2023-09-29T23:04:41.364 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.360+0000 7f04557363c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-09-29T23:04:41.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.360+0000 7f04557363c0 -1 journal do_read_entry(4096): bad header magic 2023-09-29T23:04:41.365 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.360+0000 7f04557363c0 -1 journal do_read_entry(4096): bad header magic 2023-09-29T23:04:41.380 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-29T23:04:41.393 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:04:41.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.476+0000 7f4fc20c63c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-29T23:04:41.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.476+0000 7f4fc20c63c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-29T23:04:41.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.488+0000 7f4fc20c63c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-09-29T23:04:41.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.488+0000 7f4fc20c63c0 -1 journal FileJournal::_open_file : zeroing journal 2023-09-29T23:04:41.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.560+0000 7f4fc20c63c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-09-29T23:04:41.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.560+0000 7f4fc20c63c0 -1 journal do_read_entry(4096): bad header magic 2023-09-29T23:04:41.565 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.560+0000 7f4fc20c63c0 -1 journal do_read_entry(4096): bad header magic 2023-09-29T23:04:41.580 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-29T23:04:41.594 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:04:41.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.624+0000 7f50c7d7f3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-29T23:04:41.628 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.624+0000 7f50c7d7f3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-29T23:04:41.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.636+0000 7f50c7d7f3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-09-29T23:04:41.640 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.636+0000 7f50c7d7f3c0 -1 journal FileJournal::_open_file : zeroing journal 2023-09-29T23:04:41.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.708+0000 7f50c7d7f3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-09-29T23:04:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.708+0000 7f50c7d7f3c0 -1 journal do_read_entry(4096): bad header magic 2023-09-29T23:04:41.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:41.708+0000 7f50c7d7f3c0 -1 journal do_read_entry(4096): bad header magic 2023-09-29T23:04:41.726 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-29T23:04:41.738 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-29T23:04:41.738 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:41.738 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-29T23:04:41.754 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:41.754 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-29T23:04:41.812 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:41.812 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-09-29T23:04:41.823 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:41.824 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-29T23:04:41.834 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:41.835 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-29T23:04:41.850 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:41.850 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2023-09-29T23:04:41.908 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:41.909 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-29T23:04:41.918 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:41.919 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-29T23:04:41.929 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:41.929 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-29T23:04:41.945 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:41.945 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-29T23:04:41.958 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:41.958 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-29T23:04:41.965 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:41.965 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-09-29T23:04:42.007 INFO:tasks.ceph:Adding keys to all mons... 2023-09-29T23:04:42.007 DEBUG:teuthology.orchestra.run.smithi115:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-29T23:04:42.010 DEBUG:teuthology.orchestra.run.smithi156:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-29T23:04:42.023 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.x] 2023-09-29T23:04:42.023 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAHWBdl2WqkFRAAp0US1XRgWwIr4CQSZHV7Lw== 2023-09-29T23:04:42.023 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2023-09-29T23:04:42.023 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAHWBdl2DMbHhAAqAZvpZO/FhgZC4VQuPXCWg== 2023-09-29T23:04:42.023 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2023-09-29T23:04:42.023 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAHWBdlCN+QIRAANQY0eMntcR6XQWx61sPRag== 2023-09-29T23:04:42.023 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.0] 2023-09-29T23:04:42.023 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAIWBdlaVHUHBAA5EENebFiPVRpNQ9zU5kTmA== 2023-09-29T23:04:42.023 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.y] 2023-09-29T23:04:42.023 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAHWBdl5TJiGBAAzcDDncf0H3mr/NflSjNChg== 2023-09-29T23:04:42.023 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.z] 2023-09-29T23:04:42.024 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAHWBdldb8PGxAANen/nc+RDxlzUiDa/cc6qQ== 2023-09-29T23:04:42.024 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2023-09-29T23:04:42.024 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAHWBdlE3X2JBAAbRGRrtDlSMWEYZ9HvUeixg== 2023-09-29T23:04:42.024 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.1] 2023-09-29T23:04:42.024 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAJWBdlQLt3EBAAzxisEl+Goo3Tg9FuY5f2aQ== 2023-09-29T23:04:42.024 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.2] 2023-09-29T23:04:42.024 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAJWBdlVIGZHBAAwN6nECSPngheZGC0N/+V0Q== 2023-09-29T23:04:42.024 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.3] 2023-09-29T23:04:42.024 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAJWBdljFxvJRAA1hjd8Kztx4y75SCUAzqsjw== 2023-09-29T23:04:42.024 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2023-09-29T23:04:42.024 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAHWBdloY/YKhAA69O/gN0ICQ+CLrlujbBhzA== 2023-09-29T23:04:42.024 INFO:teuthology.orchestra.run.smithi115.stdout:[client.1] 2023-09-29T23:04:42.025 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAHWBdlDrrTLRAAWkds+3AQvVaZ7h1PVx/xcg== 2023-09-29T23:04:42.025 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.x] 2023-09-29T23:04:42.025 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAHWBdl2WqkFRAAp0US1XRgWwIr4CQSZHV7Lw== 2023-09-29T23:04:42.025 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2023-09-29T23:04:42.026 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAHWBdl2DMbHhAAqAZvpZO/FhgZC4VQuPXCWg== 2023-09-29T23:04:42.026 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.c] 2023-09-29T23:04:42.026 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAHWBdlCN+QIRAANQY0eMntcR6XQWx61sPRag== 2023-09-29T23:04:42.026 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.0] 2023-09-29T23:04:42.026 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAIWBdlaVHUHBAA5EENebFiPVRpNQ9zU5kTmA== 2023-09-29T23:04:42.026 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.y] 2023-09-29T23:04:42.026 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAHWBdl5TJiGBAAzcDDncf0H3mr/NflSjNChg== 2023-09-29T23:04:42.027 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.z] 2023-09-29T23:04:42.027 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAHWBdldb8PGxAANen/nc+RDxlzUiDa/cc6qQ== 2023-09-29T23:04:42.027 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.b] 2023-09-29T23:04:42.027 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAHWBdlE3X2JBAAbRGRrtDlSMWEYZ9HvUeixg== 2023-09-29T23:04:42.027 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.1] 2023-09-29T23:04:42.027 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAJWBdlQLt3EBAAzxisEl+Goo3Tg9FuY5f2aQ== 2023-09-29T23:04:42.027 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.2] 2023-09-29T23:04:42.027 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAJWBdlVIGZHBAAwN6nECSPngheZGC0N/+V0Q== 2023-09-29T23:04:42.027 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.3] 2023-09-29T23:04:42.028 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAJWBdljFxvJRAA1hjd8Kztx4y75SCUAzqsjw== 2023-09-29T23:04:42.028 INFO:teuthology.orchestra.run.smithi156.stdout:[client.0] 2023-09-29T23:04:42.028 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAHWBdloY/YKhAA69O/gN0ICQ+CLrlujbBhzA== 2023-09-29T23:04:42.028 INFO:teuthology.orchestra.run.smithi156.stdout:[client.1] 2023-09-29T23:04:42.028 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQAHWBdlDrrTLRAAWkds+3AQvVaZ7h1PVx/xcg== 2023-09-29T23:04:42.030 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-29T23:04:42.033 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-29T23:04:42.117 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-29T23:04:42.119 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-29T23:04:42.165 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-29T23:04:42.168 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-29T23:04:42.251 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-29T23:04:42.254 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-29T23:04:42.297 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-29T23:04:42.343 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-29T23:04:42.391 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-29T23:04:42.393 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-29T23:04:42.437 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-29T23:04:42.440 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-29T23:04:42.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-29T23:04:42.527 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-29T23:04:42.571 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-29T23:04:42.574 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-29T23:04:42.656 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-29T23:04:42.658 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-29T23:04:42.701 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-29T23:04:42.703 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-29T23:04:42.793 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-29T23:04:42.796 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-29T23:04:42.844 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-29T23:04:42.844 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-29T23:04:42.857 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-29T23:04:42.908 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-29T23:04:42.920 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-29T23:04:42.930 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-29T23:04:43.033 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-29T23:04:43.046 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-29T23:04:43.063 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-29T23:04:43.162 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-29T23:04:43.175 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:04:43.177 DEBUG:teuthology.orchestra.run.smithi156:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:04:43.182 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-29T23:04:43.182 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-29T23:04:43.183 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-29T23:04:43.227 INFO:tasks.ceph.mon.a:Started 2023-09-29T23:04:43.227 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-29T23:04:43.227 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-29T23:04:43.229 INFO:tasks.ceph.mon.c:Started 2023-09-29T23:04:43.229 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-29T23:04:43.230 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-29T23:04:43.232 INFO:tasks.ceph.mon.b:Started 2023-09-29T23:04:43.232 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-29T23:04:43.233 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-29T23:04:43.233 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-29T23:04:43.235 INFO:tasks.ceph.mgr.x:Started 2023-09-29T23:04:43.235 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-29T23:04:43.236 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-29T23:04:43.238 INFO:tasks.ceph.mgr.y:Started 2023-09-29T23:04:43.238 INFO:tasks.ceph.mgr.z:Restarting daemon 2023-09-29T23:04:43.238 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2023-09-29T23:04:43.240 INFO:tasks.ceph.mgr.z:Started 2023-09-29T23:04:43.240 INFO:tasks.ceph:Setting crush tunables to default 2023-09-29T23:04:43.240 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd crush tunables default 2023-09-29T23:04:43.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.338+0000 7fabd91d6700 1 Processor -- start 2023-09-29T23:04:43.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.338+0000 7fabd91d6700 1 -- start start 2023-09-29T23:04:43.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.338+0000 7fabd91d6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:43.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.338+0000 7fabd37fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fabd40b2250 0x7fabd409d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40306/0 (socket says 172.21.15.115:40306) 2023-09-29T23:04:43.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.338+0000 7fabd37fe700 1 -- 172.21.15.115:0/932285763 learned_addr learned my addr 172.21.15.115:0/932285763 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:04:43.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.338+0000 7fabd91d6700 1 -- 172.21.15.115:0/932285763 --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd409c8f0 con 0x7fabd40b2250 2023-09-29T23:04:43.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.338+0000 7fabd91d6700 1 -- 172.21.15.115:0/932285763 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd409ecb0 con 0x7fabd4068250 2023-09-29T23:04:43.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.338+0000 7fabd89d5700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:43.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.338+0000 7fabd91d6700 1 -- 172.21.15.115:0/932285763 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd40b2bd0 con 0x7fabd409d770 2023-09-29T23:04:43.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.338+0000 7fabd89d5700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 msgr2=0x7fabd4147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-29T23:04:43.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.338+0000 7fabd89d5700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 msgr2=0x7fabd4147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-29T23:04:43.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.338+0000 7fabd89d5700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-29T23:04:43.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.338+0000 7fabd89d5700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-29T23:04:43.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.542+0000 7fabd89d5700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:43.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.542+0000 7fabd89d5700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 msgr2=0x7fabd4147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-29T23:04:43.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.542+0000 7fabd89d5700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 msgr2=0x7fabd4147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-29T23:04:43.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.542+0000 7fabd89d5700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-29T23:04:43.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.542+0000 7fabd89d5700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-29T23:04:43.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.946+0000 7fabd89d5700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:43.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.946+0000 7fabd89d5700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 msgr2=0x7fabd4147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-29T23:04:43.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.946+0000 7fabd89d5700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 msgr2=0x7fabd4147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-29T23:04:43.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.946+0000 7fabd89d5700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-29T23:04:43.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:43.946+0000 7fabd89d5700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-29T23:04:44.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:44.750+0000 7fabd89d5700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:44.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:44.750+0000 7fabd89d5700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 msgr2=0x7fabd4147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-29T23:04:44.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:44.750+0000 7fabd89d5700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 msgr2=0x7fabd4147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-29T23:04:44.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:44.750+0000 7fabd89d5700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-29T23:04:44.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:44.750+0000 7fabd89d5700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-29T23:04:46.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.338+0000 7fabd1ffb700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 msgr2=0x7fabd4147740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-29T23:04:46.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.338+0000 7fabd1ffb700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.156:3300/0 conn(0x7fabd409d770 0x7fabd4147740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:46.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.338+0000 7fabd1ffb700 1 -- 172.21.15.115:0/932285763 >> v1:172.21.15.156:6789/0 conn(0x7fabd4068250 legacy=0x7fabd40a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:46.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.338+0000 7fabd1ffb700 1 -- 172.21.15.115:0/932285763 >> v1:172.21.15.115:6789/0 conn(0x7fabd40b2250 legacy=0x7fabd409d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:46.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.338+0000 7fabd1ffb700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:46.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.338+0000 7fabd1ffb700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:46.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.338+0000 7fabd1ffb700 1 -- 172.21.15.115:0/932285763 --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd40b2bd0 con 0x7fabb4003710 2023-09-29T23:04:46.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.338+0000 7fabd1ffb700 1 -- 172.21.15.115:0/932285763 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb4008d80 con 0x7fabb40061a0 2023-09-29T23:04:46.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.338+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:46.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.338+0000 7fabd37fe700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:46.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.338+0000 7fabd3fff700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 msgr2=0x7fabb4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-29T23:04:46.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.338+0000 7fabd3fff700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 msgr2=0x7fabb4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-29T23:04:46.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.338+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-29T23:04:46.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.342+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-29T23:04:46.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.342+0000 7fabd37fe700 1 -- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 msgr2=0x7fabb4008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-29T23:04:46.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.342+0000 7fabd37fe700 1 -- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 msgr2=0x7fabb4008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-29T23:04:46.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.342+0000 7fabd37fe700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-29T23:04:46.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.342+0000 7fabd37fe700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-29T23:04:46.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.546+0000 7fabd37fe700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:46.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.546+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:46.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.546+0000 7fabd37fe700 1 -- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 msgr2=0x7fabb4008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-29T23:04:46.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.546+0000 7fabd37fe700 1 -- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 msgr2=0x7fabb4008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-29T23:04:46.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.546+0000 7fabd37fe700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-29T23:04:46.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.546+0000 7fabd37fe700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-29T23:04:46.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.546+0000 7fabd3fff700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 msgr2=0x7fabb4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-29T23:04:46.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.546+0000 7fabd3fff700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 msgr2=0x7fabb4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-29T23:04:46.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.546+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-29T23:04:46.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.546+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-29T23:04:46.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.950+0000 7fabd37fe700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:46.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.950+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:46.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.950+0000 7fabd37fe700 1 -- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 msgr2=0x7fabb4008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-29T23:04:46.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.950+0000 7fabd3fff700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 msgr2=0x7fabb4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-29T23:04:46.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.950+0000 7fabd37fe700 1 -- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 msgr2=0x7fabb4008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-29T23:04:46.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.950+0000 7fabd3fff700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 msgr2=0x7fabb4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-29T23:04:46.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.950+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-29T23:04:46.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.950+0000 7fabd37fe700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-29T23:04:46.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.950+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-29T23:04:46.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:46.950+0000 7fabd37fe700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-29T23:04:47.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:47.754+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:47.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:47.754+0000 7fabd37fe700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:47.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:47.754+0000 7fabd3fff700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 msgr2=0x7fabb4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-29T23:04:47.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:47.754+0000 7fabd3fff700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 msgr2=0x7fabb4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-29T23:04:47.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:47.754+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-29T23:04:47.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:47.754+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-29T23:04:47.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:47.754+0000 7fabd37fe700 1 -- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 msgr2=0x7fabb4008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-29T23:04:47.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:47.754+0000 7fabd37fe700 1 -- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 msgr2=0x7fabb4008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-29T23:04:47.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:47.754+0000 7fabd37fe700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-29T23:04:47.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:47.754+0000 7fabd37fe700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-29T23:04:48.816 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:48.811+0000 7f4d3f0bb000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-29T23:04:48.817 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:48.811+0000 7f7a706b2000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-29T23:04:49.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.338+0000 7fabd1ffb700 1 -- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 msgr2=0x7fabb4008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-29T23:04:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.338+0000 7fabd1ffb700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb40061a0 0x7fabb4008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.338+0000 7fabd1ffb700 1 -- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 msgr2=0x7fabb4005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-29T23:04:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.338+0000 7fabd1ffb700 1 --2- 172.21.15.115:0/932285763 >> v2:172.21.15.115:3300/0 conn(0x7fabb4003710 0x7fabb4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.338+0000 7fabd89d5700 1 -- 172.21.15.115:0/932285763 reap_dead start 2023-09-29T23:04:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.338+0000 7fabd1ffb700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb4003b50 0x7fabb4006620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.338+0000 7fabd1ffb700 1 -- 172.21.15.115:0/932285763 --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd409c330 con 0x7fabb4008770 2023-09-29T23:04:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.338+0000 7fabd1ffb700 1 -- 172.21.15.115:0/932285763 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb400fb00 con 0x7fabb4006b60 2023-09-29T23:04:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.338+0000 7fabd1ffb700 1 -- 172.21.15.115:0/932285763 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40b2bd0 con 0x7fabb4003b50 2023-09-29T23:04:49.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb4003b50 0x7fabb4006620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd2ffd700 1 -- 172.21.15.115:0/932285763 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602980568 0 0) 0x7fabd409c330 con 0x7fabb4008770 2023-09-29T23:04:49.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd3fff700 1 -- 172.21.15.115:0/932285763 >> v1:172.21.15.156:6789/0 conn(0x7fabb4006b60 legacy=0x7fabb4006f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd3fff700 1 -- 172.21.15.115:0/932285763 >> v1:172.21.15.115:6789/0 conn(0x7fabb4008770 legacy=0x7fabb400d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd3fff700 1 -- 172.21.15.115:0/932285763 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4010da0 con 0x7fabb4003b50 2023-09-29T23:04:49.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd3fff700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb4003b50 0x7fabb4006620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fabcc007fd0 tx=0x7fabcc009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=742f7d7362ee1d4f server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:49.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd2ffd700 1 -- 172.21.15.115:0/932285763 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc011750 con 0x7fabb4003b50 2023-09-29T23:04:49.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd2ffd700 1 -- 172.21.15.115:0/932285763 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc0118b0 con 0x7fabb4003b50 2023-09-29T23:04:49.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd2ffd700 1 -- 172.21.15.115:0/932285763 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc011c70 con 0x7fabb4003b50 2023-09-29T23:04:49.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd91d6700 1 -- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb4003b50 msgr2=0x7fabb4006620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd91d6700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb4003b50 0x7fabb4006620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fabcc007fd0 tx=0x7fabcc009040 comp rx=0 tx=0).stop 2023-09-29T23:04:49.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd91d6700 1 -- 172.21.15.115:0/932285763 shutdown_connections 2023-09-29T23:04:49.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd91d6700 1 --2- 172.21.15.115:0/932285763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb4003b50 0x7fabb4006620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd91d6700 1 -- 172.21.15.115:0/932285763 >> 172.21.15.115:0/932285763 conn(0x7fabd40692c0 msgr2=0x7fabd40696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:49.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd91d6700 1 -- 172.21.15.115:0/932285763 shutdown_connections 2023-09-29T23:04:49.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.342+0000 7fabd91d6700 1 -- 172.21.15.115:0/932285763 wait complete. 2023-09-29T23:04:49.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd91d6700 1 Processor -- start 2023-09-29T23:04:49.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd91d6700 1 -- start start 2023-09-29T23:04:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd91d6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb4003b50 0x7fabd413fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd91d6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabb4006b60 0x7fabd406e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd91d6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb4008770 0x7fabd406ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd91d6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd406c5e0 con 0x7fabb4006b60 2023-09-29T23:04:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd91d6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd406e040 con 0x7fabb4003b50 2023-09-29T23:04:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd91d6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd406c810 con 0x7fabb4008770 2023-09-29T23:04:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabb4006b60 0x7fabd406e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd89d5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb4008770 0x7fabd406ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd37fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabb4006b60 0x7fabd406e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41036/0 (socket says 172.21.15.115:41036) 2023-09-29T23:04:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd37fe700 1 -- 172.21.15.115:0/134521427 learned_addr learned my addr 172.21.15.115:0/134521427 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:04:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd3fff700 1 --2- 172.21.15.115:0/134521427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb4003b50 0x7fabd413fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd37fe700 1 -- 172.21.15.115:0/134521427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb4008770 msgr2=0x7fabd406ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd37fe700 1 --2- 172.21.15.115:0/134521427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb4008770 0x7fabd406ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd37fe700 1 -- 172.21.15.115:0/134521427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb4003b50 msgr2=0x7fabd413fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd37fe700 1 --2- 172.21.15.115:0/134521427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb4003b50 0x7fabd413fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd37fe700 1 -- 172.21.15.115:0/134521427 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd409ecb0 con 0x7fabb4006b60 2023-09-29T23:04:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd3fff700 1 --2- 172.21.15.115:0/134521427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb4003b50 0x7fabd413fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:04:49.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd37fe700 1 --2- 172.21.15.115:0/134521427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabb4006b60 0x7fabd406e820 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fabc40127a0 tx=0x7fabc4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:49.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabcbfff700 1 -- 172.21.15.115:0/134521427 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4017070 con 0x7fabb4006b60 2023-09-29T23:04:49.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabcbfff700 1 -- 172.21.15.115:0/134521427 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc40106b0 con 0x7fabb4006b60 2023-09-29T23:04:49.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabcbfff700 1 -- 172.21.15.115:0/134521427 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4010ab0 con 0x7fabb4006b60 2023-09-29T23:04:49.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd91d6700 1 -- 172.21.15.115:0/134521427 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd41409c0 con 0x7fabb4006b60 2023-09-29T23:04:49.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabd91d6700 1 -- 172.21.15.115:0/134521427 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd409aa50 con 0x7fabb4006b60 2023-09-29T23:04:49.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabcbfff700 1 -- 172.21.15.115:0/134521427 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fabc4025440 con 0x7fabb4006b60 2023-09-29T23:04:49.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabcbfff700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-29T23:04:49.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabcbfff700 4 mgrc handle_mgr_map Got map version 1 2023-09-29T23:04:49.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabcbfff700 4 mgrc handle_mgr_map Active mgr is now 2023-09-29T23:04:49.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabcbfff700 4 mgrc reconnect No active mgr available yet 2023-09-29T23:04:49.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.346+0000 7fabcbfff700 1 -- 172.21.15.115:0/134521427 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fabc401b760 con 0x7fabb4006b60 2023-09-29T23:04:49.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.350+0000 7fabd91d6700 1 -- 172.21.15.115:0/134521427 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd404be00 con 0x7fabb4006b60 2023-09-29T23:04:49.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.354+0000 7fabcbfff700 1 -- 172.21.15.115:0/134521427 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fabc4020070 con 0x7fabb4006b60 2023-09-29T23:04:49.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.422+0000 7fabd91d6700 1 -- 172.21.15.115:0/134521427 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fabd409e380 con 0x7fabb4006b60 2023-09-29T23:04:49.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.430+0000 7fabcbfff700 1 -- 172.21.15.115:0/134521427 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fabc4025920 con 0x7fabb4006b60 2023-09-29T23:04:49.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.430+0000 7fabd91d6700 10 mgrc shutdown 2023-09-29T23:04:49.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.430+0000 7fabd91d6700 1 -- 172.21.15.115:0/134521427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabb4006b60 msgr2=0x7fabd406e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.430+0000 7fabd91d6700 1 --2- 172.21.15.115:0/134521427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabb4006b60 0x7fabd406e820 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fabc40127a0 tx=0x7fabc4009040 comp rx=0 tx=0).stop 2023-09-29T23:04:49.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.430+0000 7fabd91d6700 1 -- 172.21.15.115:0/134521427 shutdown_connections 2023-09-29T23:04:49.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.430+0000 7fabd91d6700 1 --2- 172.21.15.115:0/134521427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabb4008770 0x7fabd406ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.430+0000 7fabd91d6700 1 --2- 172.21.15.115:0/134521427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabb4006b60 0x7fabd406e820 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.430+0000 7fabd91d6700 1 --2- 172.21.15.115:0/134521427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb4003b50 0x7fabd413fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.430+0000 7fabd91d6700 1 -- 172.21.15.115:0/134521427 >> 172.21.15.115:0/134521427 conn(0x7fabd40692c0 msgr2=0x7fabd40a1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:49.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.430+0000 7fabd91d6700 1 -- 172.21.15.115:0/134521427 shutdown_connections 2023-09-29T23:04:49.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:49.430+0000 7fabd91d6700 1 -- 172.21.15.115:0/134521427 wait complete. 2023-09-29T23:04:49.437 INFO:teuthology.orchestra.run.smithi115.stderr:adjusted tunables profile to default 2023-09-29T23:04:49.447 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-29T23:04:49.447 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-09-29T23:04:49.447 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-29T23:04:49.453 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:49.447+0000 7f4d3f0bb000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-29T23:04:49.453 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:49.451+0000 7f7a706b2000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-29T23:04:49.459 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:49.459 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-29T23:04:49.475 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:49.475 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-29T23:04:49.510 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:49.507+0000 7f4d3f0bb000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-29T23:04:49.511 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:49.507+0000 7f7a706b2000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-29T23:04:49.519 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:49.514+0000 7f9ab0e05000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-29T23:04:49.523 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-29T23:04:49.523 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-29T23:04:49.583 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 9da0e8c9-ea18-4691-87ef-fbf5502845a4 0 2023-09-29T23:04:49.623 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:49.619+0000 7f4d3f0bb000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-29T23:04:49.625 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:49.623+0000 7f7a706b2000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-29T23:04:49.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5e4a2700 1 Processor -- start 2023-09-29T23:04:49.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5e4a2700 1 -- start start 2023-09-29T23:04:49.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5e4a2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c58099910 0x7f0c5806a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5e4a2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0c58069a50 0x7f0c5813f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5e4a2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c581400c0 con 0x7f0c58068660 2023-09-29T23:04:49.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5e4a2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5809a3f0 con 0x7f0c58069a50 2023-09-29T23:04:49.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5e4a2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5813fed0 con 0x7f0c58099910 2023-09-29T23:04:49.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5dca1700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0c58068660 0x7f0c58099ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:35798/0 (socket says 172.21.15.156:35798) 2023-09-29T23:04:49.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5dca1700 1 -- 172.21.15.156:0/1547490768 learned_addr learned my addr 172.21.15.156:0/1547490768 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-29T23:04:49.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5d4a0700 1 --2- 172.21.15.156:0/1547490768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c58099910 0x7f0c5806a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5cc9f700 1 --2- 172.21.15.156:0/1547490768 >> v2:172.21.15.115:3300/0 conn(0x7f0c58069a50 0x7f0c5813f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c4ffff700 1 -- 172.21.15.156:0/1547490768 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015060569 0 0) 0x7f0c581400c0 con 0x7f0c58068660 2023-09-29T23:04:49.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c4ffff700 1 -- 172.21.15.156:0/1547490768 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c44003570 con 0x7f0c58068660 2023-09-29T23:04:49.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5d4a0700 1 -- 172.21.15.156:0/1547490768 >> v2:172.21.15.115:3300/0 conn(0x7f0c58069a50 msgr2=0x7f0c5813f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:49.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5d4a0700 1 --2- 172.21.15.156:0/1547490768 >> v2:172.21.15.115:3300/0 conn(0x7f0c58069a50 0x7f0c5813f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5d4a0700 1 -- 172.21.15.156:0/1547490768 >> v1:172.21.15.156:6789/0 conn(0x7f0c58068660 legacy=0x7f0c58099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5d4a0700 1 -- 172.21.15.156:0/1547490768 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c58140360 con 0x7f0c58099910 2023-09-29T23:04:49.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.675+0000 7f0c5d4a0700 1 --2- 172.21.15.156:0/1547490768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c58099910 0x7f0c5806a1d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c540098e0 tx=0x7f0c540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fbc206c10fa5e13 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:49.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c4ffff700 1 -- 172.21.15.156:0/1547490768 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54011630 con 0x7f0c58099910 2023-09-29T23:04:49.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c4ffff700 1 -- 172.21.15.156:0/1547490768 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c54011790 con 0x7f0c58099910 2023-09-29T23:04:49.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c4ffff700 1 -- 172.21.15.156:0/1547490768 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54011b10 con 0x7f0c58099910 2023-09-29T23:04:49.685 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1547490768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c58099910 msgr2=0x7f0c5806a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 --2- 172.21.15.156:0/1547490768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c58099910 0x7f0c5806a1d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c540098e0 tx=0x7f0c540091a0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1547490768 shutdown_connections 2023-09-29T23:04:49.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 --2- 172.21.15.156:0/1547490768 >> v2:172.21.15.115:3300/0 conn(0x7f0c58069a50 0x7f0c5813f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.686 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 --2- 172.21.15.156:0/1547490768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c58099910 0x7f0c5806a1d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1547490768 >> 172.21.15.156:0/1547490768 conn(0x7f0c580a2a60 msgr2=0x7f0c580a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:49.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1547490768 shutdown_connections 2023-09-29T23:04:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1547490768 wait complete. 2023-09-29T23:04:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 Processor -- start 2023-09-29T23:04:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 -- start start 2023-09-29T23:04:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c58068660 0x7f0c580a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58069a50 0x7f0c58152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c58099910 0x7f0c58152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58150140 con 0x7f0c58068660 2023-09-29T23:04:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580a2160 con 0x7f0c58069a50 2023-09-29T23:04:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5806e2f0 con 0x7f0c58099910 2023-09-29T23:04:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5cc9f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58069a50 0x7f0c58152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5cc9f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58069a50 0x7f0c58152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39498/0 (socket says 172.21.15.156:39498) 2023-09-29T23:04:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5cc9f700 1 -- 172.21.15.156:0/1798021003 learned_addr learned my addr 172.21.15.156:0/1798021003 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-29T23:04:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5dca1700 1 --2- 172.21.15.156:0/1798021003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c58099910 0x7f0c58152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5d4a0700 1 --2- 172.21.15.156:0/1798021003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c58068660 0x7f0c580a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5cc9f700 1 -- 172.21.15.156:0/1798021003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c58099910 msgr2=0x7f0c58152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5cc9f700 1 --2- 172.21.15.156:0/1798021003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c58099910 0x7f0c58152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5cc9f700 1 -- 172.21.15.156:0/1798021003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c58068660 msgr2=0x7f0c580a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5cc9f700 1 --2- 172.21.15.156:0/1798021003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c58068660 0x7f0c580a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5cc9f700 1 -- 172.21.15.156:0/1798021003 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c54009420 con 0x7f0c58069a50 2023-09-29T23:04:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5dca1700 1 --2- 172.21.15.156:0/1798021003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c58099910 0x7f0c58152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:04:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5cc9f700 1 --2- 172.21.15.156:0/1798021003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58069a50 0x7f0c58152750 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800ec80 tx=0x7f0c480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c4d7fa700 1 -- 172.21.15.156:0/1798021003 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800c9d0 con 0x7f0c58069a50 2023-09-29T23:04:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c4d7fa700 1 -- 172.21.15.156:0/1798021003 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4800cb30 con 0x7f0c58069a50 2023-09-29T23:04:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1798021003 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c58150330 con 0x7f0c58069a50 2023-09-29T23:04:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c4d7fa700 1 -- 172.21.15.156:0/1798021003 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48013470 con 0x7f0c58069a50 2023-09-29T23:04:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1798021003 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5809f3f0 con 0x7f0c58069a50 2023-09-29T23:04:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c4d7fa700 1 -- 172.21.15.156:0/1798021003 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0c48005c80 con 0x7f0c58069a50 2023-09-29T23:04:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c4d7fa700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-29T23:04:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c4d7fa700 4 mgrc handle_mgr_map Got map version 1 2023-09-29T23:04:49.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c4d7fa700 4 mgrc handle_mgr_map Active mgr is now 2023-09-29T23:04:49.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c4d7fa700 4 mgrc reconnect No active mgr available yet 2023-09-29T23:04:49.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.679+0000 7f0c4d7fa700 1 -- 172.21.15.156:0/1798021003 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0c48006370 con 0x7f0c58069a50 2023-09-29T23:04:49.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.683+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1798021003 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c0050e0 con 0x7f0c58069a50 2023-09-29T23:04:49.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.683+0000 7f0c4d7fa700 1 -- 172.21.15.156:0/1798021003 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0c48021060 con 0x7f0c58069a50 2023-09-29T23:04:49.785 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.783+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1798021003 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9da0e8c9-ea18-4691-87ef-fbf5502845a4", "id": 0} v 0) v1 -- 0x7f0c38005110 con 0x7f0c58069a50 2023-09-29T23:04:49.792 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.787+0000 7f0c4d7fa700 1 -- 172.21.15.156:0/1798021003 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9da0e8c9-ea18-4691-87ef-fbf5502845a4", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c48017070 con 0x7f0c58069a50 2023-09-29T23:04:49.793 INFO:teuthology.orchestra.run.smithi156.stdout:0 2023-09-29T23:04:49.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.791+0000 7f0c5e4a2700 10 mgrc shutdown 2023-09-29T23:04:49.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.791+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1798021003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58069a50 msgr2=0x7f0c58152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.794 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.791+0000 7f0c5e4a2700 1 --2- 172.21.15.156:0/1798021003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58069a50 0x7f0c58152750 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800ec80 tx=0x7f0c480091a0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.791+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1798021003 shutdown_connections 2023-09-29T23:04:49.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.791+0000 7f0c5e4a2700 1 --2- 172.21.15.156:0/1798021003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c58099910 0x7f0c58152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.791+0000 7f0c5e4a2700 1 --2- 172.21.15.156:0/1798021003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c58069a50 0x7f0c58152750 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.791+0000 7f0c5e4a2700 1 --2- 172.21.15.156:0/1798021003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c58068660 0x7f0c580a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.791+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1798021003 >> 172.21.15.156:0/1798021003 conn(0x7f0c580a2a60 msgr2=0x7f0c58062b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:49.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.791+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1798021003 shutdown_connections 2023-09-29T23:04:49.795 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.791+0000 7f0c5e4a2700 1 -- 172.21.15.156:0/1798021003 wait complete. 2023-09-29T23:04:49.812 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new eaaa380c-73da-4075-992d-ab16b36d8ee7 1 2023-09-29T23:04:49.858 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:49.855+0000 7f7a706b2000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-29T23:04:49.870 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:49.867+0000 7f4d3f0bb000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-29T23:04:49.909 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:49.903+0000 7f7a706b2000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-29T23:04:49.921 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:49.919+0000 7f4d3f0bb000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-29T23:04:49.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29dd729700 1 Processor -- start 2023-09-29T23:04:49.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29dd729700 1 -- start start 2023-09-29T23:04:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29dd729700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29d806c050 0x7f29d809de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29dd729700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d8067350 con 0x7f29d8134120 2023-09-29T23:04:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29dd729700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d806c420 con 0x7f29d80677e0 2023-09-29T23:04:49.958 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29dd729700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d80a4590 con 0x7f29d806c050 2023-09-29T23:04:49.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d67fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f29d80677e0 0x7f29d8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:35810/0 (socket says 172.21.15.156:35810) 2023-09-29T23:04:49.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d67fc700 1 -- 172.21.15.156:0/3875023042 learned_addr learned my addr 172.21.15.156:0/3875023042 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-29T23:04:49.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d6ffd700 1 --2- 172.21.15.156:0/3875023042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29d806c050 0x7f29d809de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843396000 0 0) 0x7f29d806c420 con 0x7f29d80677e0 2023-09-29T23:04:49.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29c0003570 con 0x7f29d80677e0 2023-09-29T23:04:49.961 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2156150986 0 0) 0x7f29c0003570 con 0x7f29d80677e0 2023-09-29T23:04:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29d806c050 msgr2=0x7f29d809de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 --2- 172.21.15.156:0/3875023042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29d806c050 0x7f29d809de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 >> v1:172.21.15.115:6789/0 conn(0x7f29d8134120 legacy=0x7f29d8148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d80a4850 con 0x7f29d80677e0 2023-09-29T23:04:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3987234196 0 0) 0x7f29cc001470 con 0x7f29d80677e0 2023-09-29T23:04:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 >> v1:172.21.15.156:6789/0 conn(0x7f29d80677e0 legacy=0x7f29d8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 --2- 172.21.15.156:0/3875023042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29c0003a60 0x7f29c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 --2- 172.21.15.156:0/3875023042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29d806c050 0x7f29c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 --2- 172.21.15.156:0/3875023042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0004d50 0x7f29c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d80a4590 con 0x7f29c0004d50 2023-09-29T23:04:49.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c000bb10 con 0x7f29c0003a60 2023-09-29T23:04:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c000bc80 con 0x7f29d806c050 2023-09-29T23:04:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d6ffd700 1 --2- 172.21.15.156:0/3875023042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29c0003a60 0x7f29c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d77fe700 1 --2- 172.21.15.156:0/3875023042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0004d50 0x7f29c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d6ffd700 1 -- 172.21.15.156:0/3875023042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29d806c050 msgr2=0x7f29c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d6ffd700 1 --2- 172.21.15.156:0/3875023042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29d806c050 0x7f29c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d6ffd700 1 -- 172.21.15.156:0/3875023042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0004d50 msgr2=0x7f29c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d6ffd700 1 --2- 172.21.15.156:0/3875023042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0004d50 0x7f29c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d6ffd700 1 -- 172.21.15.156:0/3875023042 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c0003570 con 0x7f29c0003a60 2023-09-29T23:04:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d77fe700 1 --2- 172.21.15.156:0/3875023042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0004d50 0x7f29c00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:04:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d6ffd700 1 --2- 172.21.15.156:0/3875023042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29c0003a60 0x7f29c0003e30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009c30 tx=0x7f29c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5637ce447ab00c56 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c800e710 con 0x7f29c0003a60 2023-09-29T23:04:49.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c800e870 con 0x7f29c0003a60 2023-09-29T23:04:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d5ffb700 1 -- 172.21.15.156:0/3875023042 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c800ec30 con 0x7f29c0003a60 2023-09-29T23:04:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29dd729700 1 -- 172.21.15.156:0/3875023042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29c0003a60 msgr2=0x7f29c0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29dd729700 1 --2- 172.21.15.156:0/3875023042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29c0003a60 0x7f29c0003e30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009c30 tx=0x7f29c80091a0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29d77fe700 1 -- 172.21.15.156:0/3875023042 reap_dead start 2023-09-29T23:04:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29dd729700 1 -- 172.21.15.156:0/3875023042 shutdown_connections 2023-09-29T23:04:49.964 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.955+0000 7f29dd729700 1 -- 172.21.15.156:0/3875023042 >> 172.21.15.156:0/3875023042 conn(0x7f29d80b4bc0 msgr2=0x7f29d806b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:49.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29dd729700 1 -- 172.21.15.156:0/3875023042 shutdown_connections 2023-09-29T23:04:49.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29dd729700 1 -- 172.21.15.156:0/3875023042 wait complete. 2023-09-29T23:04:49.966 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29dd729700 1 Processor -- start 2023-09-29T23:04:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29dd729700 1 -- start start 2023-09-29T23:04:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29dd729700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0003a60 0x7f29d80a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29dd729700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29d8096250 0x7f29d8096680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29dd729700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29d80a0ee0 0x7f29d80a1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29dd729700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d809c6e0 con 0x7f29c0003a60 2023-09-29T23:04:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29dd729700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8095a70 con 0x7f29d8096250 2023-09-29T23:04:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29dd729700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d80a3190 con 0x7f29d80a0ee0 2023-09-29T23:04:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29d67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29d8096250 0x7f29d8096680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29d67fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29d8096250 0x7f29d8096680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39514/0 (socket says 172.21.15.156:39514) 2023-09-29T23:04:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29d67fc700 1 -- 172.21.15.156:0/2402487024 learned_addr learned my addr 172.21.15.156:0/2402487024 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-29T23:04:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29d6ffd700 1 --2- 172.21.15.156:0/2402487024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0003a60 0x7f29d80a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:49.967 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29d67fc700 1 -- 172.21.15.156:0/2402487024 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29d80a0ee0 msgr2=0x7f29d80a1350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-29T23:04:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29d67fc700 1 --2- 172.21.15.156:0/2402487024 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29d80a0ee0 0x7f29d80a1350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29d67fc700 1 -- 172.21.15.156:0/2402487024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0003a60 msgr2=0x7f29d80a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29d67fc700 1 --2- 172.21.15.156:0/2402487024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0003a60 0x7f29d80a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29d67fc700 1 -- 172.21.15.156:0/2402487024 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d80a3450 con 0x7f29d8096250 2023-09-29T23:04:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29d6ffd700 1 --2- 172.21.15.156:0/2402487024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0003a60 0x7f29d80a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:04:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29d67fc700 1 --2- 172.21.15.156:0/2402487024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29d8096250 0x7f29d8096680 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00c900 tx=0x7f29cc001b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29beffd700 1 -- 172.21.15.156:0/2402487024 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00cea0 con 0x7f29d8096250 2023-09-29T23:04:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29beffd700 1 -- 172.21.15.156:0/2402487024 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc007360 con 0x7f29d8096250 2023-09-29T23:04:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29dd729700 1 -- 172.21.15.156:0/2402487024 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d8094a00 con 0x7f29d8096250 2023-09-29T23:04:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29beffd700 1 -- 172.21.15.156:0/2402487024 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc004830 con 0x7f29d8096250 2023-09-29T23:04:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.959+0000 7f29dd729700 1 -- 172.21.15.156:0/2402487024 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d80a2300 con 0x7f29d8096250 2023-09-29T23:04:49.968 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.963+0000 7f29beffd700 1 -- 172.21.15.156:0/2402487024 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f29cc00a5d0 con 0x7f29d8096250 2023-09-29T23:04:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.963+0000 7f29beffd700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-29T23:04:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.963+0000 7f29beffd700 4 mgrc handle_mgr_map Got map version 1 2023-09-29T23:04:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.963+0000 7f29beffd700 4 mgrc handle_mgr_map Active mgr is now 2023-09-29T23:04:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.963+0000 7f29beffd700 4 mgrc reconnect No active mgr available yet 2023-09-29T23:04:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.963+0000 7f29beffd700 1 -- 172.21.15.156:0/2402487024 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f29cc01d800 con 0x7f29d8096250 2023-09-29T23:04:49.969 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.963+0000 7f29dd729700 1 -- 172.21.15.156:0/2402487024 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d809c850 con 0x7f29d8096250 2023-09-29T23:04:49.970 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:49.967+0000 7f29beffd700 1 -- 172.21.15.156:0/2402487024 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f29cc018070 con 0x7f29d8096250 2023-09-29T23:04:50.061 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.059+0000 7f29dd729700 1 -- 172.21.15.156:0/2402487024 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eaaa380c-73da-4075-992d-ab16b36d8ee7", "id": 1} v 0) v1 -- 0x7f29d8070990 con 0x7f29d8096250 2023-09-29T23:04:50.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.063+0000 7f29beffd700 1 -- 172.21.15.156:0/2402487024 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eaaa380c-73da-4075-992d-ab16b36d8ee7", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f29cc004e60 con 0x7f29d8096250 2023-09-29T23:04:50.070 INFO:teuthology.orchestra.run.smithi156.stdout:1 2023-09-29T23:04:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.067+0000 7f29dd729700 10 mgrc shutdown 2023-09-29T23:04:50.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.067+0000 7f29dd729700 1 -- 172.21.15.156:0/2402487024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29d8096250 msgr2=0x7f29d8096680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.067+0000 7f29dd729700 1 --2- 172.21.15.156:0/2402487024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29d8096250 0x7f29d8096680 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00c900 tx=0x7f29cc001b70 comp rx=0 tx=0).stop 2023-09-29T23:04:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.067+0000 7f29dd729700 1 -- 172.21.15.156:0/2402487024 shutdown_connections 2023-09-29T23:04:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.067+0000 7f29dd729700 1 --2- 172.21.15.156:0/2402487024 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29d80a0ee0 0x7f29d80a1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.067+0000 7f29dd729700 1 --2- 172.21.15.156:0/2402487024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29d8096250 0x7f29d8096680 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.067+0000 7f29dd729700 1 --2- 172.21.15.156:0/2402487024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29c0003a60 0x7f29d80a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.067+0000 7f29dd729700 1 -- 172.21.15.156:0/2402487024 >> 172.21.15.156:0/2402487024 conn(0x7f29d80b4bc0 msgr2=0x7f29d80690c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.067+0000 7f29dd729700 1 -- 172.21.15.156:0/2402487024 shutdown_connections 2023-09-29T23:04:50.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.067+0000 7f29dd729700 1 -- 172.21.15.156:0/2402487024 wait complete. 2023-09-29T23:04:50.081 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 01e8286e-30af-41c7-bcd1-c4545f9f0a14 2 2023-09-29T23:04:50.099 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:50.095+0000 7f4d3f0bb000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-29T23:04:50.101 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:50.095+0000 7f7a706b2000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-29T23:04:50.154 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:50.149+0000 7f9ab0e05000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-29T23:04:50.158 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:50.155+0000 7f4d3f0bb000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-29T23:04:50.161 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:50.159+0000 7f7a706b2000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-29T23:04:50.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.187+0000 7f8c086bf700 1 Processor -- start 2023-09-29T23:04:50.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.187+0000 7f8c086bf700 1 -- start start 2023-09-29T23:04:50.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.187+0000 7f8c086bf700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8c00068b70 0x7f8c000a4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.187+0000 7f8c086bf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8c00148490 0x7f8c0014a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.187+0000 7f8c086bf700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c000a5580 con 0x7f8c000a4ea0 2023-09-29T23:04:50.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.187+0000 7f8c086bf700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c000a32b0 con 0x7f8c00148490 2023-09-29T23:04:50.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.187+0000 7f8c086bf700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c00068f40 con 0x7f8c00068b70 2023-09-29T23:04:50.194 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.187+0000 7f8c0645b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8c00068b70 0x7f8c000a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.187+0000 7f8c0645b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8c00068b70 0x7f8c000a4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39518/0 (socket says 172.21.15.156:39518) 2023-09-29T23:04:50.195 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.187+0000 7f8c0645b700 1 -- 172.21.15.156:0/1281747919 learned_addr learned my addr 172.21.15.156:0/1281747919 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-29T23:04:50.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c06c5c700 1 --2- 172.21.15.156:0/1281747919 >> v2:172.21.15.115:3300/0 conn(0x7f8c00148490 0x7f8c0014a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c0645b700 1 -- 172.21.15.156:0/1281747919 >> v2:172.21.15.115:3300/0 conn(0x7f8c00148490 msgr2=0x7f8c0014a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:50.198 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c0645b700 1 --2- 172.21.15.156:0/1281747919 >> v2:172.21.15.115:3300/0 conn(0x7f8c00148490 0x7f8c0014a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c0645b700 1 -- 172.21.15.156:0/1281747919 >> v1:172.21.15.115:6789/0 conn(0x7f8c000a4ea0 legacy=0x7f8c00142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c0645b700 1 -- 172.21.15.156:0/1281747919 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c000a52e0 con 0x7f8c00068b70 2023-09-29T23:04:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c0645b700 1 --2- 172.21.15.156:0/1281747919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c00068b70 0x7f8c000a4960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8c00067770 tx=0x7f8bfc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91022ba686f931ea server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c05459700 1 -- 172.21.15.156:0/1281747919 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc00b820 con 0x7f8c00068b70 2023-09-29T23:04:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c05459700 1 -- 172.21.15.156:0/1281747919 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc00b980 con 0x7f8c00068b70 2023-09-29T23:04:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c05459700 1 -- 172.21.15.156:0/1281747919 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc00bd40 con 0x7f8c00068b70 2023-09-29T23:04:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 -- 172.21.15.156:0/1281747919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c00068b70 msgr2=0x7f8c000a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 --2- 172.21.15.156:0/1281747919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c00068b70 0x7f8c000a4960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8c00067770 tx=0x7f8bfc009250 comp rx=0 tx=0).stop 2023-09-29T23:04:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 -- 172.21.15.156:0/1281747919 shutdown_connections 2023-09-29T23:04:50.199 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 --2- 172.21.15.156:0/1281747919 >> v2:172.21.15.115:3300/0 conn(0x7f8c00148490 0x7f8c0014a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 --2- 172.21.15.156:0/1281747919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c00068b70 0x7f8c000a4960 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 -- 172.21.15.156:0/1281747919 >> 172.21.15.156:0/1281747919 conn(0x7f8c0006a890 msgr2=0x7f8c000b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 -- 172.21.15.156:0/1281747919 shutdown_connections 2023-09-29T23:04:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 -- 172.21.15.156:0/1281747919 wait complete. 2023-09-29T23:04:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 Processor -- start 2023-09-29T23:04:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 -- start start 2023-09-29T23:04:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c000a4ea0 0x7f8c000a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c00148490 0x7f8c00144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c00138b20 0x7f8c000a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0009feb0 con 0x7f8c00138b20 2023-09-29T23:04:50.200 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0006d950 con 0x7f8c000a4ea0 2023-09-29T23:04:50.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c086bf700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0006dbf0 con 0x7f8c00148490 2023-09-29T23:04:50.201 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c0645b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c000a4ea0 0x7f8c000a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c0645b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c000a4ea0 0x7f8c000a1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39526/0 (socket says 172.21.15.156:39526) 2023-09-29T23:04:50.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c0645b700 1 -- 172.21.15.156:0/3764012992 learned_addr learned my addr 172.21.15.156:0/3764012992 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-29T23:04:50.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c05c5a700 1 --2- 172.21.15.156:0/3764012992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c00148490 0x7f8c00144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.203 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c06c5c700 1 --2- 172.21.15.156:0/3764012992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c00138b20 0x7f8c000a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c0645b700 1 -- 172.21.15.156:0/3764012992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c00148490 msgr2=0x7f8c00144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c0645b700 1 --2- 172.21.15.156:0/3764012992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c00148490 0x7f8c00144d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c0645b700 1 -- 172.21.15.156:0/3764012992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c00138b20 msgr2=0x7f8c000a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c0645b700 1 --2- 172.21.15.156:0/3764012992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c00138b20 0x7f8c000a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.191+0000 7f8c0645b700 1 -- 172.21.15.156:0/3764012992 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc0094f0 con 0x7f8c000a4ea0 2023-09-29T23:04:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.195+0000 7f8c0645b700 1 --2- 172.21.15.156:0/3764012992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c000a4ea0 0x7f8c000a1c60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8c00069080 tx=0x7f8bfc016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.195+0000 7f8bf67fc700 1 -- 172.21.15.156:0/3764012992 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc011bd0 con 0x7f8c000a4ea0 2023-09-29T23:04:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.195+0000 7f8bf67fc700 1 -- 172.21.15.156:0/3764012992 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc020070 con 0x7f8c000a4ea0 2023-09-29T23:04:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.195+0000 7f8c086bf700 1 -- 172.21.15.156:0/3764012992 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0006d5a0 con 0x7f8c000a4ea0 2023-09-29T23:04:50.204 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.195+0000 7f8bf67fc700 1 -- 172.21.15.156:0/3764012992 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc01b450 con 0x7f8c000a4ea0 2023-09-29T23:04:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.195+0000 7f8c086bf700 1 -- 172.21.15.156:0/3764012992 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c00138210 con 0x7f8c000a4ea0 2023-09-29T23:04:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.195+0000 7f8bf67fc700 1 -- 172.21.15.156:0/3764012992 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8bfc022030 con 0x7f8c000a4ea0 2023-09-29T23:04:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.195+0000 7f8bf67fc700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-29T23:04:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.195+0000 7f8bf67fc700 4 mgrc handle_mgr_map Got map version 1 2023-09-29T23:04:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.195+0000 7f8bf67fc700 4 mgrc handle_mgr_map Active mgr is now 2023-09-29T23:04:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.195+0000 7f8bf67fc700 4 mgrc reconnect No active mgr available yet 2023-09-29T23:04:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.195+0000 7f8bf67fc700 1 -- 172.21.15.156:0/3764012992 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f8bfc01c880 con 0x7f8c000a4ea0 2023-09-29T23:04:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.195+0000 7f8c086bf700 1 -- 172.21.15.156:0/3764012992 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c00063ea0 con 0x7f8c000a4ea0 2023-09-29T23:04:50.205 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.199+0000 7f8bf67fc700 1 -- 172.21.15.156:0/3764012992 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8bfc01bc60 con 0x7f8c000a4ea0 2023-09-29T23:04:50.211 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:50.205+0000 7f9ab0e05000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-29T23:04:50.220 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:50.215+0000 7f4d3f0bb000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-29T23:04:50.235 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:50.231+0000 7f7a706b2000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-29T23:04:50.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.287+0000 7f8c086bf700 1 -- 172.21.15.156:0/3764012992 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "01e8286e-30af-41c7-bcd1-c4545f9f0a14", "id": 2} v 0) v1 -- 0x7f8c00063ea0 con 0x7f8c000a4ea0 2023-09-29T23:04:50.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.295+0000 7f8bf67fc700 1 -- 172.21.15.156:0/3764012992 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01e8286e-30af-41c7-bcd1-c4545f9f0a14", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8bfc01c450 con 0x7f8c000a4ea0 2023-09-29T23:04:50.300 INFO:teuthology.orchestra.run.smithi156.stdout:2 2023-09-29T23:04:50.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.295+0000 7f8c086bf700 10 mgrc shutdown 2023-09-29T23:04:50.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.295+0000 7f8c086bf700 1 -- 172.21.15.156:0/3764012992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c000a4ea0 msgr2=0x7f8c000a1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.295+0000 7f8c086bf700 1 --2- 172.21.15.156:0/3764012992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c000a4ea0 0x7f8c000a1c60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8c00069080 tx=0x7f8bfc016000 comp rx=0 tx=0).stop 2023-09-29T23:04:50.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.295+0000 7f8c086bf700 1 -- 172.21.15.156:0/3764012992 shutdown_connections 2023-09-29T23:04:50.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.295+0000 7f8c086bf700 1 --2- 172.21.15.156:0/3764012992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c00138b20 0x7f8c000a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.295+0000 7f8c086bf700 1 --2- 172.21.15.156:0/3764012992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c00148490 0x7f8c00144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.295+0000 7f8c086bf700 1 --2- 172.21.15.156:0/3764012992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c000a4ea0 0x7f8c000a1c60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.295+0000 7f8c086bf700 1 -- 172.21.15.156:0/3764012992 >> 172.21.15.156:0/3764012992 conn(0x7f8c0006a890 msgr2=0x7f8c0013e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:50.302 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.295+0000 7f8c086bf700 1 -- 172.21.15.156:0/3764012992 shutdown_connections 2023-09-29T23:04:50.303 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.295+0000 7f8c086bf700 1 -- 172.21.15.156:0/3764012992 wait complete. 2023-09-29T23:04:50.311 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 4f6a1234-5ac6-43b0-baaa-3567ab7c73a1 3 2023-09-29T23:04:50.327 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:50.321+0000 7f9ab0e05000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-29T23:04:50.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f2cf9700 1 Processor -- start 2023-09-29T23:04:50.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f2cf9700 1 -- start start 2023-09-29T23:04:50.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f2cf9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10ec069a50 0x7f10ec06a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f2cf9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f10ec13f990 0x7f10ec099ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f2cf9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec13fe30 con 0x7f10ec099910 2023-09-29T23:04:50.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f2cf9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec1400c0 con 0x7f10ec13f990 2023-09-29T23:04:50.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f2cf9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec140360 con 0x7f10ec069a50 2023-09-29T23:04:50.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f1cf7700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f10ec099910 0x7f10ec068660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:35820/0 (socket says 172.21.15.156:35820) 2023-09-29T23:04:50.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f1cf7700 1 -- 172.21.15.156:0/252402226 learned_addr learned my addr 172.21.15.156:0/252402226 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-09-29T23:04:50.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f24f8700 1 --2- 172.21.15.156:0/252402226 >> v2:172.21.15.156:3300/0 conn(0x7f10ec13f990 0x7f10ec099ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f14f6700 1 --2- 172.21.15.156:0/252402226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10ec069a50 0x7f10ec06a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f24f8700 1 -- 172.21.15.156:0/252402226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10ec069a50 msgr2=0x7f10ec06a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:50.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f24f8700 1 --2- 172.21.15.156:0/252402226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10ec069a50 0x7f10ec06a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f24f8700 1 -- 172.21.15.156:0/252402226 >> v1:172.21.15.156:6789/0 conn(0x7f10ec099910 legacy=0x7f10ec068660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f0cf5700 1 -- 172.21.15.156:0/252402226 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460570107 0 0) 0x7f10ec13fe30 con 0x7f10ec099910 2023-09-29T23:04:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f24f8700 1 -- 172.21.15.156:0/252402226 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec09a220 con 0x7f10ec13f990 2023-09-29T23:04:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f24f8700 1 --2- 172.21.15.156:0/252402226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10ec13f990 0x7f10ec099ce0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f10e80098e0 tx=0x7f10e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f358b1e03aad1825 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f0cf5700 1 -- 172.21.15.156:0/252402226 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8009e80 con 0x7f10ec13f990 2023-09-29T23:04:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f0cf5700 1 -- 172.21.15.156:0/252402226 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e800b860 con 0x7f10ec13f990 2023-09-29T23:04:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.403+0000 7f10f0cf5700 1 -- 172.21.15.156:0/252402226 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e800bbe0 con 0x7f10ec13f990 2023-09-29T23:04:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 -- 172.21.15.156:0/252402226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10ec13f990 msgr2=0x7f10ec099ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 --2- 172.21.15.156:0/252402226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10ec13f990 0x7f10ec099ce0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f10e80098e0 tx=0x7f10e80091a0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 -- 172.21.15.156:0/252402226 shutdown_connections 2023-09-29T23:04:50.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 --2- 172.21.15.156:0/252402226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10ec13f990 0x7f10ec099ce0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 --2- 172.21.15.156:0/252402226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10ec069a50 0x7f10ec06a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 -- 172.21.15.156:0/252402226 >> 172.21.15.156:0/252402226 conn(0x7f10ec0a2a60 msgr2=0x7f10ec0a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:50.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 -- 172.21.15.156:0/252402226 shutdown_connections 2023-09-29T23:04:50.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 -- 172.21.15.156:0/252402226 wait complete. 2023-09-29T23:04:50.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 Processor -- start 2023-09-29T23:04:50.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 -- start start 2023-09-29T23:04:50.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10ec069a50 0x7f10ec09dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10ec099910 0x7f10ec1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10ec13f990 0x7f10ec140d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec153600 con 0x7f10ec069a50 2023-09-29T23:04:50.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec138dd0 con 0x7f10ec099910 2023-09-29T23:04:50.416 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f2cf9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec0a1c40 con 0x7f10ec13f990 2023-09-29T23:04:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f14f6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10ec099910 0x7f10ec1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f14f6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10ec099910 0x7f10ec1530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:39552/0 (socket says 172.21.15.156:39552) 2023-09-29T23:04:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f14f6700 1 -- 172.21.15.156:0/3267282524 learned_addr learned my addr 172.21.15.156:0/3267282524 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-29T23:04:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f1cf7700 1 --2- 172.21.15.156:0/3267282524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10ec069a50 0x7f10ec09dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.407+0000 7f10f24f8700 1 --2- 172.21.15.156:0/3267282524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10ec13f990 0x7f10ec140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10f14f6700 1 -- 172.21.15.156:0/3267282524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10ec13f990 msgr2=0x7f10ec140d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10f14f6700 1 --2- 172.21.15.156:0/3267282524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10ec13f990 0x7f10ec140d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10f14f6700 1 -- 172.21.15.156:0/3267282524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10ec069a50 msgr2=0x7f10ec09dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10f14f6700 1 --2- 172.21.15.156:0/3267282524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10ec069a50 0x7f10ec09dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10f14f6700 1 -- 172.21.15.156:0/3267282524 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e8009420 con 0x7f10ec099910 2023-09-29T23:04:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10f1cf7700 1 --2- 172.21.15.156:0/3267282524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10ec069a50 0x7f10ec09dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:04:50.417 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10f24f8700 1 --2- 172.21.15.156:0/3267282524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10ec13f990 0x7f10ec140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:04:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10f14f6700 1 --2- 172.21.15.156:0/3267282524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10ec099910 0x7f10ec1530c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00d890 tx=0x7f10dc008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10e1ffb700 1 -- 172.21.15.156:0/3267282524 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc00b600 con 0x7f10ec099910 2023-09-29T23:04:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10e1ffb700 1 -- 172.21.15.156:0/3267282524 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc00b760 con 0x7f10ec099910 2023-09-29T23:04:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10f2cf9700 1 -- 172.21.15.156:0/3267282524 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec0a2270 con 0x7f10ec099910 2023-09-29T23:04:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10e1ffb700 1 -- 172.21.15.156:0/3267282524 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc00bae0 con 0x7f10ec099910 2023-09-29T23:04:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10f2cf9700 1 -- 172.21.15.156:0/3267282524 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec138a10 con 0x7f10ec099910 2023-09-29T23:04:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10e1ffb700 1 -- 172.21.15.156:0/3267282524 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f10dc01e6e0 con 0x7f10ec099910 2023-09-29T23:04:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10e1ffb700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-29T23:04:50.418 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10e1ffb700 4 mgrc handle_mgr_map Got map version 1 2023-09-29T23:04:50.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10e1ffb700 4 mgrc handle_mgr_map Active mgr is now 2023-09-29T23:04:50.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10e1ffb700 4 mgrc reconnect No active mgr available yet 2023-09-29T23:04:50.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10e1ffb700 1 -- 172.21.15.156:0/3267282524 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f10dc014490 con 0x7f10ec099910 2023-09-29T23:04:50.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.411+0000 7f10f2cf9700 1 -- 172.21.15.156:0/3267282524 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec04be00 con 0x7f10ec099910 2023-09-29T23:04:50.419 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.415+0000 7f10e1ffb700 1 -- 172.21.15.156:0/3267282524 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f10dc01e990 con 0x7f10ec099910 2023-09-29T23:04:50.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.483+0000 7f10f2cf9700 1 -- 172.21.15.156:0/3267282524 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4f6a1234-5ac6-43b0-baaa-3567ab7c73a1", "id": 3} v 0) v1 -- 0x7f10ec09c430 con 0x7f10ec099910 2023-09-29T23:04:50.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.491+0000 7f10e1ffb700 1 -- 172.21.15.156:0/3267282524 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f6a1234-5ac6-43b0-baaa-3567ab7c73a1", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f10dc01ebb0 con 0x7f10ec099910 2023-09-29T23:04:50.495 INFO:teuthology.orchestra.run.smithi156.stdout:3 2023-09-29T23:04:50.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.491+0000 7f10f2cf9700 10 mgrc shutdown 2023-09-29T23:04:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.491+0000 7f10f2cf9700 1 -- 172.21.15.156:0/3267282524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10ec099910 msgr2=0x7f10ec1530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.491+0000 7f10f2cf9700 1 --2- 172.21.15.156:0/3267282524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10ec099910 0x7f10ec1530c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00d890 tx=0x7f10dc008040 comp rx=0 tx=0).stop 2023-09-29T23:04:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.491+0000 7f10f2cf9700 1 -- 172.21.15.156:0/3267282524 shutdown_connections 2023-09-29T23:04:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.491+0000 7f10f2cf9700 1 --2- 172.21.15.156:0/3267282524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10ec13f990 0x7f10ec140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.491+0000 7f10f2cf9700 1 --2- 172.21.15.156:0/3267282524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10ec099910 0x7f10ec1530c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.491+0000 7f10f2cf9700 1 --2- 172.21.15.156:0/3267282524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10ec069a50 0x7f10ec09dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.491+0000 7f10f2cf9700 1 -- 172.21.15.156:0/3267282524 >> 172.21.15.156:0/3267282524 conn(0x7f10ec0a2a60 msgr2=0x7f10ec0b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.491+0000 7f10f2cf9700 1 -- 172.21.15.156:0/3267282524 shutdown_connections 2023-09-29T23:04:50.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-29T23:04:50.491+0000 7f10f2cf9700 1 -- 172.21.15.156:0/3267282524 wait complete. 2023-09-29T23:04:50.508 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-29T23:04:50.508 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-29T23:04:50.519 INFO:tasks.ceph.osd.0:Started 2023-09-29T23:04:50.519 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-29T23:04:50.520 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-29T23:04:50.532 INFO:tasks.ceph.osd.1:Started 2023-09-29T23:04:50.532 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-29T23:04:50.532 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-29T23:04:50.534 INFO:tasks.ceph.osd.2:Started 2023-09-29T23:04:50.535 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-29T23:04:50.535 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-29T23:04:50.539 INFO:tasks.ceph.osd.3:Started 2023-09-29T23:04:50.539 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:04:50.552 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:50.545+0000 7f9ab0e05000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-29T23:04:50.591 INFO:tasks.ceph.osd.0.smithi115.stderr:2023-09-29T23:04:50.585+0000 7fde72a0e3c0 -1 Falling back to public interface 2023-09-29T23:04:50.611 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-29T23:04:50.607+0000 7f9c713133c0 -1 Falling back to public interface 2023-09-29T23:04:50.612 INFO:tasks.ceph.osd.0.smithi115.stderr:2023-09-29T23:04:50.605+0000 7fde72a0e3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-09-29T23:04:50.612 INFO:tasks.ceph.osd.0.smithi115.stderr:2023-09-29T23:04:50.605+0000 7fde72a0e3c0 -1 journal do_read_entry(8192): bad header magic 2023-09-29T23:04:50.612 INFO:tasks.ceph.osd.0.smithi115.stderr:2023-09-29T23:04:50.605+0000 7fde72a0e3c0 -1 journal do_read_entry(8192): bad header magic 2023-09-29T23:04:50.615 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-29T23:04:50.611+0000 7f048a2043c0 -1 Falling back to public interface 2023-09-29T23:04:50.616 INFO:tasks.ceph.osd.0.smithi115.stderr:2023-09-29T23:04:50.609+0000 7fde72a0e3c0 -1 osd.0 0 log_to_monitors true 2023-09-29T23:04:50.616 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-29T23:04:50.611+0000 7f38602203c0 -1 Falling back to public interface 2023-09-29T23:04:50.617 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:50.609+0000 7f9ab0e05000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-29T23:04:50.632 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-29T23:04:50.627+0000 7f048a2043c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-09-29T23:04:50.633 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-29T23:04:50.627+0000 7f048a2043c0 -1 journal do_read_entry(8192): bad header magic 2023-09-29T23:04:50.633 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-29T23:04:50.627+0000 7f048a2043c0 -1 journal do_read_entry(8192): bad header magic 2023-09-29T23:04:50.633 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-29T23:04:50.627+0000 7f9c713133c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-09-29T23:04:50.633 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-29T23:04:50.627+0000 7f9c713133c0 -1 journal do_read_entry(8192): bad header magic 2023-09-29T23:04:50.633 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-29T23:04:50.627+0000 7f9c713133c0 -1 journal do_read_entry(8192): bad header magic 2023-09-29T23:04:50.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.629+0000 7f5eb7fff700 1 Processor -- start 2023-09-29T23:04:50.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.629+0000 7f5eb7fff700 1 -- start start 2023-09-29T23:04:50.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5eb80a6670 0x7f5eb8141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5eb8141ab0 0x7f5eb80a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb806f220 con 0x7f5eb80a62a0 2023-09-29T23:04:50.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb8068790 con 0x7f5eb8141ab0 2023-09-29T23:04:50.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80a54a0 con 0x7f5eb80a6670 2023-09-29T23:04:50.639 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-29T23:04:50.635+0000 7f9c713133c0 -1 osd.1 0 log_to_monitors true 2023-09-29T23:04:50.639 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-29T23:04:50.635+0000 7f38602203c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-09-29T23:04:50.640 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-29T23:04:50.635+0000 7f38602203c0 -1 journal do_read_entry(8192): bad header magic 2023-09-29T23:04:50.640 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-29T23:04:50.635+0000 7f38602203c0 -1 journal do_read_entry(8192): bad header magic 2023-09-29T23:04:50.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb77fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5eb8141ab0 0x7f5eb80a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb67fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5eb80a6670 0x7f5eb8141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb77fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5eb8141ab0 0x7f5eb80a4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41046/0 (socket says 172.21.15.115:41046) 2023-09-29T23:04:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb77fe700 1 -- 172.21.15.115:0/2444953204 learned_addr learned my addr 172.21.15.115:0/2444953204 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:04:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb77fe700 1 -- 172.21.15.115:0/2444953204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5eb80a6670 msgr2=0x7f5eb8141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb77fe700 1 --2- 172.21.15.115:0/2444953204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5eb80a6670 0x7f5eb8141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb77fe700 1 -- 172.21.15.115:0/2444953204 >> v1:172.21.15.156:6789/0 conn(0x7f5eb80a62a0 legacy=0x7f5eb806e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb77fe700 1 -- 172.21.15.115:0/2444953204 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb8140e60 con 0x7f5eb8141ab0 2023-09-29T23:04:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb77fe700 1 --2- 172.21.15.115:0/2444953204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5eb8141ab0 0x7f5eb80a4a40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80099b0 tx=0x7f5ea8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f50fc873ea42082 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb5ffb700 1 -- 172.21.15.115:0/2444953204 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8009ea0 con 0x7f5eb8141ab0 2023-09-29T23:04:50.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb5ffb700 1 -- 172.21.15.115:0/2444953204 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea800b860 con 0x7f5eb8141ab0 2023-09-29T23:04:50.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb5ffb700 1 -- 172.21.15.115:0/2444953204 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea800bc00 con 0x7f5eb8141ab0 2023-09-29T23:04:50.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 -- 172.21.15.115:0/2444953204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5eb8141ab0 msgr2=0x7f5eb80a4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 --2- 172.21.15.115:0/2444953204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5eb8141ab0 0x7f5eb80a4a40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80099b0 tx=0x7f5ea8009250 comp rx=0 tx=0).stop 2023-09-29T23:04:50.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 -- 172.21.15.115:0/2444953204 shutdown_connections 2023-09-29T23:04:50.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 --2- 172.21.15.115:0/2444953204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5eb8141ab0 0x7f5eb80a4a40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 --2- 172.21.15.115:0/2444953204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5eb80a6670 0x7f5eb8141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 -- 172.21.15.115:0/2444953204 >> 172.21.15.115:0/2444953204 conn(0x7f5eb80a3470 msgr2=0x7f5eb80a3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:50.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 -- 172.21.15.115:0/2444953204 shutdown_connections 2023-09-29T23:04:50.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 -- 172.21.15.115:0/2444953204 wait complete. 2023-09-29T23:04:50.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 Processor -- start 2023-09-29T23:04:50.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.633+0000 7f5eb7fff700 1 -- start start 2023-09-29T23:04:50.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5eb80a62a0 0x7f5eb80b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5eb80a6670 0x7f5eb80abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5eb8141ab0 0x7f5eb80a8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:50.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80a8a00 con 0x7f5eb80a62a0 2023-09-29T23:04:50.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb7fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80a8cc0 con 0x7f5eb8141ab0 2023-09-29T23:04:50.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb7fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80b46f0 con 0x7f5eb80a6670 2023-09-29T23:04:50.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5eb80a62a0 0x7f5eb80b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5eb80a62a0 0x7f5eb80b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41052/0 (socket says 172.21.15.115:41052) 2023-09-29T23:04:50.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb6ffd700 1 -- 172.21.15.115:0/1370890182 learned_addr learned my addr 172.21.15.115:0/1370890182 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:04:50.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb67fc700 1 --2- 172.21.15.115:0/1370890182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5eb80a6670 0x7f5eb80abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb77fe700 1 --2- 172.21.15.115:0/1370890182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5eb8141ab0 0x7f5eb80a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:50.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb6ffd700 1 -- 172.21.15.115:0/1370890182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5eb80a6670 msgr2=0x7f5eb80abd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb6ffd700 1 --2- 172.21.15.115:0/1370890182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5eb80a6670 0x7f5eb80abd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb6ffd700 1 -- 172.21.15.115:0/1370890182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5eb8141ab0 msgr2=0x7f5eb80a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb6ffd700 1 --2- 172.21.15.115:0/1370890182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5eb8141ab0 0x7f5eb80a8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb6ffd700 1 -- 172.21.15.115:0/1370890182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea80094f0 con 0x7f5eb80a62a0 2023-09-29T23:04:50.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb6ffd700 1 --2- 172.21.15.115:0/1370890182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5eb80a62a0 0x7f5eb80b3b20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00c4e0 tx=0x7f5eac00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:50.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5e9effd700 1 -- 172.21.15.115:0/1370890182 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac011590 con 0x7f5eb80a62a0 2023-09-29T23:04:50.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5e9effd700 1 -- 172.21.15.115:0/1370890182 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac011710 con 0x7f5eb80a62a0 2023-09-29T23:04:50.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb7fff700 1 -- 172.21.15.115:0/1370890182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb80ac5e0 con 0x7f5eb80a62a0 2023-09-29T23:04:50.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5e9effd700 1 -- 172.21.15.115:0/1370890182 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac011ad0 con 0x7f5eb80a62a0 2023-09-29T23:04:50.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5eb7fff700 1 -- 172.21.15.115:0/1370890182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb8138c20 con 0x7f5eb80a62a0 2023-09-29T23:04:50.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5e9effd700 1 -- 172.21.15.115:0/1370890182 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5eac01c6c0 con 0x7f5eb80a62a0 2023-09-29T23:04:50.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5e9effd700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-29T23:04:50.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5e9effd700 4 mgrc handle_mgr_map Got map version 1 2023-09-29T23:04:50.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5e9effd700 4 mgrc handle_mgr_map Active mgr is now 2023-09-29T23:04:50.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5e9effd700 4 mgrc reconnect No active mgr available yet 2023-09-29T23:04:50.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.637+0000 7f5e9effd700 1 -- 172.21.15.115:0/1370890182 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f5eac012930 con 0x7f5eb80a62a0 2023-09-29T23:04:50.649 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-29T23:04:50.635+0000 7f048a2043c0 -1 osd.2 0 log_to_monitors true 2023-09-29T23:04:50.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.641+0000 7f5eb7fff700 1 -- 172.21.15.115:0/1370890182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb8138e40 con 0x7f5eb80a62a0 2023-09-29T23:04:50.649 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-29T23:04:50.643+0000 7f38602203c0 -1 osd.3 0 log_to_monitors true 2023-09-29T23:04:50.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.645+0000 7f5e9effd700 1 -- 172.21.15.115:0/1370890182 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5eac017070 con 0x7f5eb80a62a0 2023-09-29T23:04:50.661 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:50.659+0000 7f4d3f0bb000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-29T23:04:50.662 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:50.659+0000 7f7a706b2000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-29T23:04:50.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.713+0000 7f5eb7fff700 1 -- 172.21.15.115:0/1370890182 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5eb804be00 con 0x7f5eb80a62a0 2023-09-29T23:04:50.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.713+0000 7f5e9effd700 1 -- 172.21.15.115:0/1370890182 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7f5eac01cba0 con 0x7f5eb80a62a0 2023-09-29T23:04:50.719 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:04:50.719 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":6,"fsid":"593687ae-01c7-4a32-a91e-931db75fb751","created":"2023-09-29T23:04:48.574873+0000","modified":"2023-09-29T23:04:50.489116+0000","last_up_change":"0.000000","last_in_change":"2023-09-29T23:04:50.489116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9da0e8c9-ea18-4691-87ef-fbf5502845a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eaaa380c-73da-4075-992d-ab16b36d8ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"01e8286e-30af-41c7-bcd1-c4545f9f0a14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4f6a1234-5ac6-43b0-baaa-3567ab7c73a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:04:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.713+0000 7f5eb7fff700 10 mgrc shutdown 2023-09-29T23:04:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.713+0000 7f5eb7fff700 1 -- 172.21.15.115:0/1370890182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5eb80a62a0 msgr2=0x7f5eb80b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.713+0000 7f5eb7fff700 1 --2- 172.21.15.115:0/1370890182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5eb80a62a0 0x7f5eb80b3b20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00c4e0 tx=0x7f5eac00c7f0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.713+0000 7f5eb7fff700 1 -- 172.21.15.115:0/1370890182 shutdown_connections 2023-09-29T23:04:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.713+0000 7f5eb7fff700 1 --2- 172.21.15.115:0/1370890182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5eb8141ab0 0x7f5eb80a8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.713+0000 7f5eb7fff700 1 --2- 172.21.15.115:0/1370890182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5eb80a6670 0x7f5eb80abd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.713+0000 7f5eb7fff700 1 --2- 172.21.15.115:0/1370890182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5eb80a62a0 0x7f5eb80b3b20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:50.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.713+0000 7f5eb7fff700 1 -- 172.21.15.115:0/1370890182 >> 172.21.15.115:0/1370890182 conn(0x7f5eb80a3470 msgr2=0x7f5eb80a3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:50.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.713+0000 7f5eb7fff700 1 -- 172.21.15.115:0/1370890182 shutdown_connections 2023-09-29T23:04:50.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:50.713+0000 7f5eb7fff700 1 -- 172.21.15.115:0/1370890182 wait complete. 2023-09-29T23:04:50.733 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-29T23:04:50.734 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-29T23:04:50.772 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:50.767+0000 7f4d3f0bb000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-29T23:04:50.776 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:50.771+0000 7f7a706b2000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-29T23:04:50.831 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:50.825+0000 7f9ab0e05000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-29T23:04:50.895 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:50.889+0000 7f9ab0e05000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-29T23:04:50.961 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:50.957+0000 7f9ab0e05000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-29T23:04:51.072 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:51.067+0000 7f4d3f0bb000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-29T23:04:51.089 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:51.087+0000 7f7a706b2000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-29T23:04:51.136 DEBUG:teuthology.orchestra.run.smithi115:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-29T23:04:51.231 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8044101700 1 Processor -- start 2023-09-29T23:04:51.231 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8044101700 1 -- start start 2023-09-29T23:04:51.233 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8044101700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a3770 0x7f803c0a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:51.233 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8044101700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f803c0a4e10 0x7f803c13be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:51.233 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8044101700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c0a3b40 con 0x7f803c13c3d0 2023-09-29T23:04:51.233 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8044101700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803c140d10 con 0x7f803c0a4e10 2023-09-29T23:04:51.233 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8044101700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0b3d70 con 0x7f803c0a3770 2023-09-29T23:04:51.233 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f804269e700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f803c13c3d0 0x7f803c13fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43172/0 (socket says 172.21.15.115:43172) 2023-09-29T23:04:51.233 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8041e9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a3770 0x7f803c0a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:51.234 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f804269e700 1 -- 172.21.15.115:0/1699535532 learned_addr learned my addr 172.21.15.115:0/1699535532 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:04:51.234 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f804169c700 1 --2- 172.21.15.115:0/1699535532 >> v2:172.21.15.115:3300/0 conn(0x7f803c0a4e10 0x7f803c13be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:51.234 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8040e9b700 1 -- 172.21.15.115:0/1699535532 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278471423 0 0) 0x7f803c0a3b40 con 0x7f803c13c3d0 2023-09-29T23:04:51.234 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8040e9b700 1 -- 172.21.15.115:0/1699535532 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8028003570 con 0x7f803c13c3d0 2023-09-29T23:04:51.234 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8040e9b700 1 -- 172.21.15.115:0/1699535532 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 976218964 0 0) 0x7f8028003570 con 0x7f803c13c3d0 2023-09-29T23:04:51.234 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f804169c700 1 -- 172.21.15.115:0/1699535532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a3770 msgr2=0x7f803c0a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:51.234 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f804169c700 1 --2- 172.21.15.115:0/1699535532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a3770 0x7f803c0a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:51.234 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f804169c700 1 -- 172.21.15.115:0/1699535532 >> v1:172.21.15.115:6789/0 conn(0x7f803c13c3d0 legacy=0x7f803c13fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:51.234 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f804169c700 1 -- 172.21.15.115:0/1699535532 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c140a50 con 0x7f803c0a4e10 2023-09-29T23:04:51.234 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8041e9d700 1 --2- 172.21.15.115:0/1699535532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a3770 0x7f803c0a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:04:51.234 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f804169c700 1 --2- 172.21.15.115:0/1699535532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0a4e10 0x7f803c13be90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f80380098e0 tx=0x7f80380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f39856df60a172 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:51.235 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8040e9b700 1 -- 172.21.15.115:0/1699535532 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340017f0 con 0x7f803c0a4e10 2023-09-29T23:04:51.235 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8040e9b700 1 -- 172.21.15.115:0/1699535532 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8038011420 con 0x7f803c0a4e10 2023-09-29T23:04:51.235 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.225+0000 7f8040e9b700 1 -- 172.21.15.115:0/1699535532 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80380117a0 con 0x7f803c0a4e10 2023-09-29T23:04:51.236 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 -- 172.21.15.115:0/1699535532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0a4e10 msgr2=0x7f803c13be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:51.236 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 --2- 172.21.15.115:0/1699535532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0a4e10 0x7f803c13be90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f80380098e0 tx=0x7f80380091a0 comp rx=0 tx=0).stop 2023-09-29T23:04:51.236 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 -- 172.21.15.115:0/1699535532 shutdown_connections 2023-09-29T23:04:51.236 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 --2- 172.21.15.115:0/1699535532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0a4e10 0x7f803c13be90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:51.236 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 --2- 172.21.15.115:0/1699535532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a3770 0x7f803c0a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:51.236 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 -- 172.21.15.115:0/1699535532 >> 172.21.15.115:0/1699535532 conn(0x7f803c06c9c0 msgr2=0x7f803c06cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:51.236 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 -- 172.21.15.115:0/1699535532 shutdown_connections 2023-09-29T23:04:51.236 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 -- 172.21.15.115:0/1699535532 wait complete. 2023-09-29T23:04:51.237 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 Processor -- start 2023-09-29T23:04:51.237 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 -- start start 2023-09-29T23:04:51.239 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803c0a3770 0x7f803c0a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:51.239 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a4e10 0x7f803c1435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:51.239 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c13c3d0 0x7f803c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:51.239 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c09ee40 con 0x7f803c13c3d0 2023-09-29T23:04:51.239 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c150b90 con 0x7f803c0a3770 2023-09-29T23:04:51.239 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f8044101700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c150dc0 con 0x7f803c0a4e10 2023-09-29T23:04:51.239 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f804269e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c13c3d0 0x7f803c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:51.239 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.229+0000 7f804169c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a4e10 0x7f803c1435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:51.239 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f804169c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a4e10 0x7f803c1435b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:55392/0 (socket says 172.21.15.115:55392) 2023-09-29T23:04:51.240 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f804269e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c13c3d0 0x7f803c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41076/0 (socket says 172.21.15.115:41076) 2023-09-29T23:04:51.240 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f8041e9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803c0a3770 0x7f803c0a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:51.240 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f804169c700 1 -- 172.21.15.115:0/4090284996 learned_addr learned my addr 172.21.15.115:0/4090284996 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:04:51.240 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f804269e700 1 -- 172.21.15.115:0/4090284996 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a4e10 msgr2=0x7f803c1435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:51.240 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f804269e700 1 --2- 172.21.15.115:0/4090284996 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a4e10 0x7f803c1435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:51.240 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f804269e700 1 -- 172.21.15.115:0/4090284996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803c0a3770 msgr2=0x7f803c0a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:51.240 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f804269e700 1 --2- 172.21.15.115:0/4090284996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803c0a3770 0x7f803c0a2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:51.245 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f804269e700 1 -- 172.21.15.115:0/4090284996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8030009420 con 0x7f803c13c3d0 2023-09-29T23:04:51.245 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f804269e700 1 --2- 172.21.15.115:0/4090284996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c13c3d0 0x7f803c09dcf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f803400cb60 tx=0x7f8034007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:51.245 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f802dffb700 1 -- 172.21.15.115:0/4090284996 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034004dc0 con 0x7f803c13c3d0 2023-09-29T23:04:51.245 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f802dffb700 1 -- 172.21.15.115:0/4090284996 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803400a5d0 con 0x7f803c13c3d0 2023-09-29T23:04:51.245 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f8044101700 1 -- 172.21.15.115:0/4090284996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8038009420 con 0x7f803c13c3d0 2023-09-29T23:04:51.245 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f802dffb700 1 -- 172.21.15.115:0/4090284996 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803400a990 con 0x7f803c13c3d0 2023-09-29T23:04:51.245 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f8044101700 1 -- 172.21.15.115:0/4090284996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803c0a2780 con 0x7f803c13c3d0 2023-09-29T23:04:51.245 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f802dffb700 1 -- 172.21.15.115:0/4090284996 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8034007150 con 0x7f803c13c3d0 2023-09-29T23:04:51.246 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f802dffb700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-29T23:04:51.246 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f802dffb700 4 mgrc handle_mgr_map Got map version 1 2023-09-29T23:04:51.246 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f802dffb700 4 mgrc handle_mgr_map Active mgr is now 2023-09-29T23:04:51.246 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f802dffb700 4 mgrc reconnect No active mgr available yet 2023-09-29T23:04:51.246 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f802dffb700 1 -- 172.21.15.115:0/4090284996 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f8034012400 con 0x7f803c13c3d0 2023-09-29T23:04:51.247 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:51.235+0000 7f4d3f0bb000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-29T23:04:51.247 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.233+0000 7f8044101700 1 -- 172.21.15.115:0/4090284996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803c1432d0 con 0x7f803c13c3d0 2023-09-29T23:04:51.247 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.237+0000 7f802dffb700 1 -- 172.21.15.115:0/4090284996 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f803c1432d0 con 0x7f803c13c3d0 2023-09-29T23:04:51.258 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:51.255+0000 7f7a706b2000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-29T23:04:51.307 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.301+0000 7f8044101700 1 -- 172.21.15.115:0/4090284996 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f803c04be00 con 0x7f803c13c3d0 2023-09-29T23:04:51.308 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.301+0000 7f802dffb700 1 -- 172.21.15.115:0/4090284996 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7f8034018070 con 0x7f803c13c3d0 2023-09-29T23:04:51.308 INFO:teuthology.misc.health.smithi115.stdout: 2023-09-29T23:04:51.308 INFO:teuthology.misc.health.smithi115.stdout:{"epoch":6,"fsid":"593687ae-01c7-4a32-a91e-931db75fb751","created":"2023-09-29T23:04:48.574873+0000","modified":"2023-09-29T23:04:50.489116+0000","last_up_change":"0.000000","last_in_change":"2023-09-29T23:04:50.489116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9da0e8c9-ea18-4691-87ef-fbf5502845a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eaaa380c-73da-4075-992d-ab16b36d8ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"01e8286e-30af-41c7-bcd1-c4545f9f0a14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4f6a1234-5ac6-43b0-baaa-3567ab7c73a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:04:51.310 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.301+0000 7f8044101700 10 mgrc shutdown 2023-09-29T23:04:51.310 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.301+0000 7f8044101700 1 -- 172.21.15.115:0/4090284996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c13c3d0 msgr2=0x7f803c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:51.310 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.301+0000 7f8044101700 1 --2- 172.21.15.115:0/4090284996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c13c3d0 0x7f803c09dcf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f803400cb60 tx=0x7f8034007f30 comp rx=0 tx=0).stop 2023-09-29T23:04:51.310 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.301+0000 7f8044101700 1 -- 172.21.15.115:0/4090284996 shutdown_connections 2023-09-29T23:04:51.310 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.301+0000 7f8044101700 1 --2- 172.21.15.115:0/4090284996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c13c3d0 0x7f803c09dcf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:51.310 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.301+0000 7f8044101700 1 --2- 172.21.15.115:0/4090284996 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a4e10 0x7f803c1435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:51.310 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.301+0000 7f8044101700 1 --2- 172.21.15.115:0/4090284996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803c0a3770 0x7f803c0a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:51.310 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.301+0000 7f8044101700 1 -- 172.21.15.115:0/4090284996 >> 172.21.15.115:0/4090284996 conn(0x7f803c06c9c0 msgr2=0x7f803c0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:51.310 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.305+0000 7f8044101700 1 -- 172.21.15.115:0/4090284996 shutdown_connections 2023-09-29T23:04:51.311 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:51.305+0000 7f8044101700 1 -- 172.21.15.115:0/4090284996 wait complete. 2023-09-29T23:04:51.319 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-09-29T23:04:51.321 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:51.315+0000 7f4d3f0bb000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-29T23:04:51.324 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:51.319+0000 7f7a706b2000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-29T23:04:51.370 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:51.365+0000 7f9ab0e05000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-29T23:04:51.374 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:51.371+0000 7f4d3f0bb000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-29T23:04:51.380 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:51.375+0000 7f7a706b2000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-29T23:04:51.432 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:51.427+0000 7f4d3f0bb000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-29T23:04:51.436 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:51.431+0000 7f7a706b2000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-29T23:04:51.490 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:51.485+0000 7f9ab0e05000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-29T23:04:51.736 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:51.731+0000 7f7a706b2000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-29T23:04:51.737 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:51.735+0000 7f4d3f0bb000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-29T23:04:51.794 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:51.791+0000 7f4d3f0bb000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-29T23:04:51.796 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:51.791+0000 7f7a706b2000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-29T23:04:51.810 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:51.805+0000 7f9ab0e05000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-29T23:04:51.860 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:51.855+0000 7f4d3f0bb000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-29T23:04:51.864 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:51.859+0000 7f7a706b2000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-29T23:04:51.979 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:51.973+0000 7f9ab0e05000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-29T23:04:52.023 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:52.019+0000 7f4d3f0bb000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-29T23:04:52.037 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:52.031+0000 7f7a706b2000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-29T23:04:52.044 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:52.037+0000 7f9ab0e05000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-29T23:04:52.089 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:52.087+0000 7f4d3f0bb000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-29T23:04:52.094 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:52.091+0000 7f7a706b2000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-29T23:04:52.095 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:52.089+0000 7f9ab0e05000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-29T23:04:52.153 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:52.145+0000 7f9ab0e05000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-29T23:04:52.440 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:52.433+0000 7f9ab0e05000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-29T23:04:52.495 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:52.489+0000 7f9ab0e05000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-29T23:04:52.566 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:52.561+0000 7f9ab0e05000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-29T23:04:52.610 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-29T23:04:52.607+0000 7f9c6dad7700 -1 osd.1 0 waiting for initial osdmap 2023-09-29T23:04:52.617 INFO:tasks.ceph.osd.0.smithi115.stderr:2023-09-29T23:04:52.609+0000 7fde6f1d2700 -1 osd.0 0 waiting for initial osdmap 2023-09-29T23:04:52.617 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-29T23:04:52.615+0000 7f385c9e4700 -1 osd.3 0 waiting for initial osdmap 2023-09-29T23:04:52.618 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-29T23:04:52.615+0000 7f04869c8700 -1 osd.2 0 waiting for initial osdmap 2023-09-29T23:04:52.619 INFO:tasks.ceph.osd.0.smithi115.stderr:2023-09-29T23:04:52.613+0000 7fde6af7c700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-29T23:04:52.619 INFO:tasks.ceph.osd.3.smithi156.stderr:2023-09-29T23:04:52.615+0000 7f385878e700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-29T23:04:52.620 INFO:tasks.ceph.osd.2.smithi156.stderr:2023-09-29T23:04:52.615+0000 7f0482772700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-29T23:04:52.637 INFO:tasks.ceph.osd.1.smithi156.stderr:2023-09-29T23:04:52.635+0000 7f9c69881700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-29T23:04:52.731 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:52.725+0000 7f9ab0e05000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-29T23:04:52.796 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:52.789+0000 7f9ab0e05000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-29T23:04:52.822 INFO:tasks.ceph.mgr.z.smithi156.stderr:2023-09-29T23:04:52.819+0000 7f7a706b2000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-29T23:04:52.822 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:52.819+0000 7f4d3f0bb000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-29T23:04:52.858 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:52.855+0000 7f4d1c99e700 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'pg_autoscaler' while running on mgr.y: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-29T23:04:52.858 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:52.855+0000 7f4d1c99e700 -1 pg_autoscaler.serve: 2023-09-29T23:04:52.861 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:52.855+0000 7f4d1c99e700 -1 Traceback (most recent call last): 2023-09-29T23:04:52.861 INFO:tasks.ceph.mgr.y.smithi156.stderr: File "/usr/share/ceph/mgr/pg_autoscaler/module.py", line 325, in serve 2023-09-29T23:04:52.861 INFO:tasks.ceph.mgr.y.smithi156.stderr: self._maybe_adjust() 2023-09-29T23:04:52.861 INFO:tasks.ceph.mgr.y.smithi156.stderr: File "/usr/share/ceph/mgr/pg_autoscaler/module.py", line 682, in _maybe_adjust 2023-09-29T23:04:52.862 INFO:tasks.ceph.mgr.y.smithi156.stderr: if self.noautoscale: 2023-09-29T23:04:52.862 INFO:tasks.ceph.mgr.y.smithi156.stderr:AttributeError: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-29T23:04:52.862 INFO:tasks.ceph.mgr.y.smithi156.stderr: 2023-09-29T23:04:53.500 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-09-29T23:04:53.493+0000 7f9ab0e05000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-29T23:04:53.858 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:53.855+0000 7f4d281b5700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-29T23:04:53.859 INFO:tasks.ceph.mgr.y.smithi156.stderr:2023-09-29T23:04:53.855+0000 7f4d281b5700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-29T23:04:53.859 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-09-29T23:04:53.853+0000 7f8e19d8c700 -1 log_channel(cluster) log [ERR] : Health check failed: Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale' (MGR_MODULE_ERROR) 2023-09-29T23:04:57.722 DEBUG:teuthology.orchestra.run.smithi115:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-29T23:04:57.819 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315d50c700 1 Processor -- start 2023-09-29T23:04:57.819 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315d50c700 1 -- start start 2023-09-29T23:04:57.821 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315d50c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f315806faf0 0x7f315813c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:57.821 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315d50c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f315813cd10 0x7f3158147090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:57.821 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315d50c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315813d6e0 con 0x7f3158068250 2023-09-29T23:04:57.822 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315d50c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31580a5aa0 con 0x7f315813cd10 2023-09-29T23:04:57.822 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315d50c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315806ee30 con 0x7f315806faf0 2023-09-29T23:04:57.822 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315cd0b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f315813cd10 0x7f3158147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:57.822 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f3157fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3158068250 0x7f315813bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42578/0 (socket says 172.21.15.115:42578) 2023-09-29T23:04:57.822 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f3157fff700 1 -- 172.21.15.115:0/1073324048 learned_addr learned my addr 172.21.15.115:0/1073324048 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:04:57.822 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f31577fe700 1 --2- 172.21.15.115:0/1073324048 >> v2:172.21.15.156:3300/0 conn(0x7f315806faf0 0x7f315813c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:57.822 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315cd0b700 1 -- 172.21.15.115:0/1073324048 >> v2:172.21.15.156:3300/0 conn(0x7f315806faf0 msgr2=0x7f315813c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:57.822 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315cd0b700 1 --2- 172.21.15.115:0/1073324048 >> v2:172.21.15.156:3300/0 conn(0x7f315806faf0 0x7f315813c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:57.822 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315cd0b700 1 -- 172.21.15.115:0/1073324048 >> v1:172.21.15.115:6789/0 conn(0x7f3158068250 legacy=0x7f315813bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:57.822 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315cd0b700 1 -- 172.21.15.115:0/1073324048 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315813d440 con 0x7f315813cd10 2023-09-29T23:04:57.822 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f3156ffd700 1 -- 172.21.15.115:0/1073324048 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319471541 0 0) 0x7f315813d6e0 con 0x7f3158068250 2023-09-29T23:04:57.823 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f31577fe700 1 --2- 172.21.15.115:0/1073324048 >> v2:172.21.15.156:3300/0 conn(0x7f315806faf0 0x7f315813c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:04:57.823 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315cd0b700 1 --2- 172.21.15.115:0/1073324048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315813cd10 0x7f3158147090 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f315806c2a0 tx=0x7f31500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cc867101eb57af server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:57.823 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f3156ffd700 1 -- 172.21.15.115:0/1073324048 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000b6b0 con 0x7f315813cd10 2023-09-29T23:04:57.823 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f3156ffd700 1 -- 172.21.15.115:0/1073324048 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315000b810 con 0x7f315813cd10 2023-09-29T23:04:57.823 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f3156ffd700 1 -- 172.21.15.115:0/1073324048 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000bbb0 con 0x7f315813cd10 2023-09-29T23:04:57.823 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315d50c700 1 -- 172.21.15.115:0/1073324048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315813cd10 msgr2=0x7f3158147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:57.823 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.817+0000 7f315d50c700 1 --2- 172.21.15.115:0/1073324048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315813cd10 0x7f3158147090 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f315806c2a0 tx=0x7f31500091a0 comp rx=0 tx=0).stop 2023-09-29T23:04:57.823 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 -- 172.21.15.115:0/1073324048 shutdown_connections 2023-09-29T23:04:57.823 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 --2- 172.21.15.115:0/1073324048 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315813cd10 0x7f3158147090 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:57.823 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 --2- 172.21.15.115:0/1073324048 >> v2:172.21.15.156:3300/0 conn(0x7f315806faf0 0x7f315813c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:57.823 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 -- 172.21.15.115:0/1073324048 >> 172.21.15.115:0/1073324048 conn(0x7f31580b1d40 msgr2=0x7f31580b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:57.824 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 -- 172.21.15.115:0/1073324048 shutdown_connections 2023-09-29T23:04:57.824 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 -- 172.21.15.115:0/1073324048 wait complete. 2023-09-29T23:04:57.826 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 Processor -- start 2023-09-29T23:04:57.826 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 -- start start 2023-09-29T23:04:57.826 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3158068250 0x7f3158137a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:57.826 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315806faf0 0x7f3158138260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:57.826 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f315813cd10 0x7f3158136050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:57.826 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3158130770 con 0x7f315806faf0 2023-09-29T23:04:57.826 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3158137600 con 0x7f3158068250 2023-09-29T23:04:57.826 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3158138820 con 0x7f315813cd10 2023-09-29T23:04:57.826 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f31577fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315806faf0 0x7f3158138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:57.826 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315cd0b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f315813cd10 0x7f3158136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:57.827 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315cd0b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f315813cd10 0x7f3158136050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:38808/0 (socket says 172.21.15.115:38808) 2023-09-29T23:04:57.827 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f31577fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315806faf0 0x7f3158138260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48966/0 (socket says 172.21.15.115:48966) 2023-09-29T23:04:57.827 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315cd0b700 1 -- 172.21.15.115:0/3334320751 learned_addr learned my addr 172.21.15.115:0/3334320751 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:04:57.827 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f3157fff700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3158068250 0x7f3158137a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:57.827 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f31577fe700 1 -- 172.21.15.115:0/3334320751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f315813cd10 msgr2=0x7f3158136050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:57.827 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f31577fe700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f315813cd10 0x7f3158136050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:57.827 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f31577fe700 1 -- 172.21.15.115:0/3334320751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3158068250 msgr2=0x7f3158137a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:57.827 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f31577fe700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3158068250 0x7f3158137a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:57.827 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f31577fe700 1 -- 172.21.15.115:0/3334320751 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150009420 con 0x7f315806faf0 2023-09-29T23:04:57.827 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315cd0b700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f315813cd10 0x7f3158136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:04:57.827 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f31577fe700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315806faf0 0x7f3158138260 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f314800d180 tx=0x7f31480099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:57.827 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f313ffff700 1 -- 172.21.15.115:0/3334320751 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800dcc0 con 0x7f315806faf0 2023-09-29T23:04:57.828 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f313ffff700 1 -- 172.21.15.115:0/3334320751 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314800f040 con 0x7f315806faf0 2023-09-29T23:04:57.828 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f313ffff700 1 -- 172.21.15.115:0/3334320751 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148015440 con 0x7f315806faf0 2023-09-29T23:04:57.828 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 -- 172.21.15.115:0/3334320751 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3158138d10 con 0x7f315806faf0 2023-09-29T23:04:57.828 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.821+0000 7f315d50c700 1 -- 172.21.15.115:0/3334320751 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31580a1940 con 0x7f315806faf0 2023-09-29T23:04:57.828 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.825+0000 7f315d50c700 1 -- 172.21.15.115:0/3334320751 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315804be00 con 0x7f315806faf0 2023-09-29T23:04:57.829 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.825+0000 7f313ffff700 1 -- 172.21.15.115:0/3334320751 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f31480157b0 con 0x7f315806faf0 2023-09-29T23:04:57.829 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.825+0000 7f313ffff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:04:57.830 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.829+0000 7f313ffff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:04:57.830 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.829+0000 7f313ffff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:04:57.830 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.829+0000 7f313ffff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:04:57.830 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.829+0000 7f313ffff700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f314408e8b0 0x7f3144090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:57.831 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.829+0000 7f313ffff700 1 -- 172.21.15.115:0/3334320751 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3125+0+0 (secure 0 0 0) 0x7f31480b4d20 con 0x7f315806faf0 2023-09-29T23:04:57.831 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.829+0000 7f3157fff700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f314408e8b0 0x7f3144090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:57.831 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.829+0000 7f3157fff700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f314408e8b0 0x7f3144090d60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f314c007fd0 tx=0x7f314c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:57.833 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.833+0000 7f313ffff700 1 -- 172.21.15.115:0/3334320751 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3148085c00 con 0x7f315806faf0 2023-09-29T23:04:57.987 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.985+0000 7f315d50c700 1 -- 172.21.15.115:0/3334320751 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31580b1270 con 0x7f315806faf0 2023-09-29T23:04:57.988 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.985+0000 7f313ffff700 1 -- 172.21.15.115:0/3334320751 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7471 (secure 0 0 0) 0x7f314801a070 con 0x7f315806faf0 2023-09-29T23:04:57.989 INFO:teuthology.misc.health.smithi115.stdout: 2023-09-29T23:04:57.989 INFO:teuthology.misc.health.smithi115.stdout:{"epoch":13,"fsid":"593687ae-01c7-4a32-a91e-931db75fb751","created":"2023-09-29T23:04:48.574873+0000","modified":"2023-09-29T23:04:57.655991+0000","last_up_change":"2023-09-29T23:04:53.614158+0000","last_in_change":"2023-09-29T23:04:50.489116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-29T23:04:54.900033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"9da0e8c9-ea18-4691-87ef-fbf5502845a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":26662},{"type":"v1","addr":"172.21.15.115:6801","nonce":26662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":26662},{"type":"v1","addr":"172.21.15.115:6803","nonce":26662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":26662},{"type":"v1","addr":"172.21.15.115:6807","nonce":26662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":26662},{"type":"v1","addr":"172.21.15.115:6805","nonce":26662}]},"public_addr":"172.21.15.115:6801/26662","cluster_addr":"172.21.15.115:6803/26662","heartbeat_back_addr":"172.21.15.115:6807/26662","heartbeat_front_addr":"172.21.15.115:6805/26662","state":["exists","up"]},{"osd":1,"uuid":"eaaa380c-73da-4075-992d-ab16b36d8ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":26874},{"type":"v1","addr":"172.21.15.156:6801","nonce":26874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":26874},{"type":"v1","addr":"172.21.15.156:6803","nonce":26874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":26874},{"type":"v1","addr":"172.21.15.156:6807","nonce":26874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":26874},{"type":"v1","addr":"172.21.15.156:6805","nonce":26874}]},"public_addr":"172.21.15.156:6801/26874","cluster_addr":"172.21.15.156:6803/26874","heartbeat_back_addr":"172.21.15.156:6807/26874","heartbeat_front_addr":"172.21.15.156:6805/26874","state":["exists","up"]},{"osd":2,"uuid":"01e8286e-30af-41c7-bcd1-c4545f9f0a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":26873},{"type":"v1","addr":"172.21.15.156:6809","nonce":26873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":26873},{"type":"v1","addr":"172.21.15.156:6811","nonce":26873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":26873},{"type":"v1","addr":"172.21.15.156:6817","nonce":26873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":26873},{"type":"v1","addr":"172.21.15.156:6813","nonce":26873}]},"public_addr":"172.21.15.156:6809/26873","cluster_addr":"172.21.15.156:6811/26873","heartbeat_back_addr":"172.21.15.156:6817/26873","heartbeat_front_addr":"172.21.15.156:6813/26873","state":["exists","up"]},{"osd":3,"uuid":"4f6a1234-5ac6-43b0-baaa-3567ab7c73a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6815","nonce":26875},{"type":"v1","addr":"172.21.15.156:6816","nonce":26875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":26875},{"type":"v1","addr":"172.21.15.156:6819","nonce":26875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":26875},{"type":"v1","addr":"172.21.15.156:6823","nonce":26875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":26875},{"type":"v1","addr":"172.21.15.156:6821","nonce":26875}]},"public_addr":"172.21.15.156:6816/26875","cluster_addr":"172.21.15.156:6819/26875","heartbeat_back_addr":"172.21.15.156:6823/26875","heartbeat_front_addr":"172.21.15.156:6821/26875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.582513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.686413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:04:57.991 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.989+0000 7f315d50c700 10 mgrc shutdown 2023-09-29T23:04:57.991 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.989+0000 7f315d50c700 1 -- 172.21.15.115:0/3334320751 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f314408e8b0 msgr2=0x7f3144090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:57.991 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.989+0000 7f315d50c700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f314408e8b0 0x7f3144090d60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f314c007fd0 tx=0x7f314c007d30 comp rx=0 tx=0).stop 2023-09-29T23:04:57.991 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.989+0000 7f315d50c700 1 -- 172.21.15.115:0/3334320751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315806faf0 msgr2=0x7f3158138260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:57.991 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.989+0000 7f315d50c700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315806faf0 0x7f3158138260 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f314800d180 tx=0x7f31480099d0 comp rx=0 tx=0).stop 2023-09-29T23:04:57.991 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.989+0000 7f315d50c700 1 -- 172.21.15.115:0/3334320751 shutdown_connections 2023-09-29T23:04:57.991 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.989+0000 7f315d50c700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f315813cd10 0x7f3158136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:57.991 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.989+0000 7f315d50c700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f314408e8b0 0x7f3144090d60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:57.991 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.989+0000 7f315d50c700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f315806faf0 0x7f3158138260 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:57.992 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.989+0000 7f315d50c700 1 --2- 172.21.15.115:0/3334320751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3158068250 0x7f3158137a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:57.992 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.989+0000 7f315d50c700 1 -- 172.21.15.115:0/3334320751 >> 172.21.15.115:0/3334320751 conn(0x7f31580b1d40 msgr2=0x7f3158139e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:57.992 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.989+0000 7f315d50c700 1 -- 172.21.15.115:0/3334320751 shutdown_connections 2023-09-29T23:04:57.992 INFO:teuthology.misc.health.smithi115.stderr:2023-09-29T23:04:57.989+0000 7f315d50c700 1 -- 172.21.15.115:0/3334320751 wait complete. 2023-09-29T23:04:58.001 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-09-29T23:04:58.001 INFO:tasks.ceph:Creating RBD pool 2023-09-29T23:04:58.001 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-29T23:04:58.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f3fff700 1 Processor -- start 2023-09-29T23:04:58.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f3fff700 1 -- start start 2023-09-29T23:04:58.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f51f406e8d0 0x7f51f40a4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:58.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51f4143510 0x7f51f4135e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:58.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f3fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f40a4d80 con 0x7f51f41359d0 2023-09-29T23:04:58.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f3fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f406a5b0 con 0x7f51f406e8d0 2023-09-29T23:04:58.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f3fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f406eca0 con 0x7f51f4143510 2023-09-29T23:04:58.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f2ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f51f406e8d0 0x7f51f40a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:58.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f2ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f51f406e8d0 0x7f51f40a4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48972/0 (socket says 172.21.15.115:48972) 2023-09-29T23:04:58.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51ebfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f51f41359d0 0x7f51f4142e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42582/0 (socket says 172.21.15.115:42582) 2023-09-29T23:04:58.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f2ffd700 1 -- 172.21.15.115:0/846813462 learned_addr learned my addr 172.21.15.115:0/846813462 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:04:58.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f37fe700 1 --2- 172.21.15.115:0/846813462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51f4143510 0x7f51f4135e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:58.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f27fc700 1 -- 172.21.15.115:0/846813462 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939685155 0 0) 0x7f51f40a4d80 con 0x7f51f41359d0 2023-09-29T23:04:58.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f2ffd700 1 -- 172.21.15.115:0/846813462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51f4143510 msgr2=0x7f51f4135e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:58.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f2ffd700 1 --2- 172.21.15.115:0/846813462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51f4143510 0x7f51f4135e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f2ffd700 1 -- 172.21.15.115:0/846813462 >> v1:172.21.15.115:6789/0 conn(0x7f51f41359d0 legacy=0x7f51f4142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:58.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f2ffd700 1 -- 172.21.15.115:0/846813462 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f4143a90 con 0x7f51f406e8d0 2023-09-29T23:04:58.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f2ffd700 1 --2- 172.21.15.115:0/846813462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51f406e8d0 0x7f51f40a4520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f51e40099b0 tx=0x7f51e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd176e8ae65a888 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:58.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f27fc700 1 -- 172.21.15.115:0/846813462 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4009ea0 con 0x7f51f406e8d0 2023-09-29T23:04:58.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f27fc700 1 -- 172.21.15.115:0/846813462 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400b860 con 0x7f51f406e8d0 2023-09-29T23:04:58.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.109+0000 7f51f27fc700 1 -- 172.21.15.115:0/846813462 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400bc00 con 0x7f51f406e8d0 2023-09-29T23:04:58.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 -- 172.21.15.115:0/846813462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51f406e8d0 msgr2=0x7f51f40a4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:58.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 --2- 172.21.15.115:0/846813462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51f406e8d0 0x7f51f40a4520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f51e40099b0 tx=0x7f51e4009250 comp rx=0 tx=0).stop 2023-09-29T23:04:58.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 -- 172.21.15.115:0/846813462 shutdown_connections 2023-09-29T23:04:58.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 --2- 172.21.15.115:0/846813462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51f4143510 0x7f51f4135e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 --2- 172.21.15.115:0/846813462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51f406e8d0 0x7f51f40a4520 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 -- 172.21.15.115:0/846813462 >> 172.21.15.115:0/846813462 conn(0x7f51f40b3ef0 msgr2=0x7f51f40b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:58.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 -- 172.21.15.115:0/846813462 shutdown_connections 2023-09-29T23:04:58.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 -- 172.21.15.115:0/846813462 wait complete. 2023-09-29T23:04:58.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 Processor -- start 2023-09-29T23:04:58.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 -- start start 2023-09-29T23:04:58.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51f406e8d0 0x7f51f40a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:58.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51f41359d0 0x7f51f40996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:58.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51f4143510 0x7f51f409fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:58.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40a0080 con 0x7f51f41359d0 2023-09-29T23:04:58.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40a0270 con 0x7f51f4143510 2023-09-29T23:04:58.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f3fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f40a0510 con 0x7f51f406e8d0 2023-09-29T23:04:58.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51ebfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51f41359d0 0x7f51f40996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:58.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51ebfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51f41359d0 0x7f51f40996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48988/0 (socket says 172.21.15.115:48988) 2023-09-29T23:04:58.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51ebfff700 1 -- 172.21.15.115:0/33446889 learned_addr learned my addr 172.21.15.115:0/33446889 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:04:58.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f2ffd700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51f406e8d0 0x7f51f40a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:58.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f37fe700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51f4143510 0x7f51f409fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:58.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51ebfff700 1 -- 172.21.15.115:0/33446889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51f406e8d0 msgr2=0x7f51f40a3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:58.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51ebfff700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51f406e8d0 0x7f51f40a3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51ebfff700 1 -- 172.21.15.115:0/33446889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51f4143510 msgr2=0x7f51f409fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:58.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51ebfff700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51f4143510 0x7f51f409fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51ebfff700 1 -- 172.21.15.115:0/33446889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e40094f0 con 0x7f51f41359d0 2023-09-29T23:04:58.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.113+0000 7f51f37fe700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51f4143510 0x7f51f409fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:04:58.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.117+0000 7f51ebfff700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51f41359d0 0x7f51f40996d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0011e0 tx=0x7f51dc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:58.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.117+0000 7f51eaffd700 1 -- 172.21.15.115:0/33446889 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc005a70 con 0x7f51f41359d0 2023-09-29T23:04:58.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.117+0000 7f51eaffd700 1 -- 172.21.15.115:0/33446889 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc005bd0 con 0x7f51f41359d0 2023-09-29T23:04:58.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.117+0000 7f51f3fff700 1 -- 172.21.15.115:0/33446889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f409efc0 con 0x7f51f41359d0 2023-09-29T23:04:58.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.117+0000 7f51eaffd700 1 -- 172.21.15.115:0/33446889 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0070d0 con 0x7f51f41359d0 2023-09-29T23:04:58.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.117+0000 7f51f3fff700 1 -- 172.21.15.115:0/33446889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f409ae70 con 0x7f51f41359d0 2023-09-29T23:04:58.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.117+0000 7f51f3fff700 1 -- 172.21.15.115:0/33446889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f404be00 con 0x7f51f41359d0 2023-09-29T23:04:58.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.121+0000 7f51eaffd700 1 -- 172.21.15.115:0/33446889 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f51dc007440 con 0x7f51f41359d0 2023-09-29T23:04:58.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.121+0000 7f51eaffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:04:58.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.121+0000 7f51eaffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:04:58.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.121+0000 7f51eaffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:04:58.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.121+0000 7f51eaffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:04:58.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.121+0000 7f51eaffd700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f51d808e8b0 0x7f51d8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:58.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.121+0000 7f51eaffd700 1 -- 172.21.15.115:0/33446889 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3125+0+0 (secure 0 0 0) 0x7f51dc0b3b20 con 0x7f51f41359d0 2023-09-29T23:04:58.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.121+0000 7f51f2ffd700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f51d808e8b0 0x7f51d8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:58.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.121+0000 7f51f2ffd700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f51d808e8b0 0x7f51d8090d60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f51e40099b0 tx=0x7f51e4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:58.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.129+0000 7f51eaffd700 1 -- 172.21.15.115:0/33446889 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f51dc084a90 con 0x7f51f41359d0 2023-09-29T23:04:58.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.297+0000 7f51f3fff700 1 -- 172.21.15.115:0/33446889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f51f40a4a60 con 0x7f51f41359d0 2023-09-29T23:04:58.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51eaffd700 1 -- 172.21.15.115:0/33446889 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f51dc0210a0 con 0x7f51f41359d0 2023-09-29T23:04:58.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51f3fff700 10 mgrc shutdown 2023-09-29T23:04:58.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51f3fff700 1 -- 172.21.15.115:0/33446889 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f51d808e8b0 msgr2=0x7f51d8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:58.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51f3fff700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f51d808e8b0 0x7f51d8090d60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f51e40099b0 tx=0x7f51e4017000 comp rx=0 tx=0).stop 2023-09-29T23:04:58.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51f3fff700 1 -- 172.21.15.115:0/33446889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51f41359d0 msgr2=0x7f51f40996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:58.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51f3fff700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51f41359d0 0x7f51f40996d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0011e0 tx=0x7f51dc007e10 comp rx=0 tx=0).stop 2023-09-29T23:04:58.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51f3fff700 1 -- 172.21.15.115:0/33446889 shutdown_connections 2023-09-29T23:04:58.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51f3fff700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51f4143510 0x7f51f409fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51f3fff700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f51d808e8b0 0x7f51d8090d60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51f3fff700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51f41359d0 0x7f51f40996d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51f3fff700 1 --2- 172.21.15.115:0/33446889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f51f406e8d0 0x7f51f40a3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51f3fff700 1 -- 172.21.15.115:0/33446889 >> 172.21.15.115:0/33446889 conn(0x7f51f40b3ef0 msgr2=0x7f51f40a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:58.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51f3fff700 1 -- 172.21.15.115:0/33446889 shutdown_connections 2023-09-29T23:04:58.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.785+0000 7f51f3fff700 1 -- 172.21.15.115:0/33446889 wait complete. 2023-09-29T23:04:58.790 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'rbd' created 2023-09-29T23:04:58.802 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-29T23:04:58.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.909+0000 7f1397fff700 1 Processor -- start 2023-09-29T23:04:58.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.909+0000 7f1397fff700 1 -- start start 2023-09-29T23:04:58.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1397fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1398067240 0x7f139809e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:58.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1397fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f139806f360 0x7f139806f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:58.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1397fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139809eb20 con 0x7f139809ccf0 2023-09-29T23:04:58.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1397fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13981402a0 con 0x7f139806f360 2023-09-29T23:04:58.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1397fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1398140540 con 0x7f1398067240 2023-09-29T23:04:58.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1396ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1398067240 0x7f139809e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:58.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f138e7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f139806f360 0x7f139806f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:58.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1396ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1398067240 0x7f139809e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:38828/0 (socket says 172.21.15.115:38828) 2023-09-29T23:04:58.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f138e7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f139806f360 0x7f139806f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49000/0 (socket says 172.21.15.115:49000) 2023-09-29T23:04:58.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1396ffd700 1 -- 172.21.15.115:0/4060925475 learned_addr learned my addr 172.21.15.115:0/4060925475 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:04:58.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f138e7fc700 1 -- 172.21.15.115:0/4060925475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1398067240 msgr2=0x7f139809e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:58.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f138e7fc700 1 --2- 172.21.15.115:0/4060925475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1398067240 0x7f139809e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f138e7fc700 1 -- 172.21.15.115:0/4060925475 >> v1:172.21.15.115:6789/0 conn(0x7f139809ccf0 legacy=0x7f13980b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:58.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f138e7fc700 1 -- 172.21.15.115:0/4060925475 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1398067610 con 0x7f139806f360 2023-09-29T23:04:58.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f138e7fc700 1 --2- 172.21.15.115:0/4060925475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f139806f360 0x7f139806f730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f13800098e0 tx=0x7f13800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c75a0a46b36027d server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:58.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f13967fc700 1 -- 172.21.15.115:0/4060925475 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138000b640 con 0x7f139806f360 2023-09-29T23:04:58.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f13967fc700 1 -- 172.21.15.115:0/4060925475 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138000b7a0 con 0x7f139806f360 2023-09-29T23:04:58.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f13967fc700 1 -- 172.21.15.115:0/4060925475 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138000bb40 con 0x7f139806f360 2023-09-29T23:04:58.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1397fff700 1 -- 172.21.15.115:0/4060925475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f139806f360 msgr2=0x7f139806f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:58.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1397fff700 1 --2- 172.21.15.115:0/4060925475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f139806f360 0x7f139806f730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f13800098e0 tx=0x7f13800091a0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1397fff700 1 -- 172.21.15.115:0/4060925475 shutdown_connections 2023-09-29T23:04:58.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1397fff700 1 --2- 172.21.15.115:0/4060925475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f139806f360 0x7f139806f730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1397fff700 1 --2- 172.21.15.115:0/4060925475 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1398067240 0x7f139809e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1397fff700 1 -- 172.21.15.115:0/4060925475 >> 172.21.15.115:0/4060925475 conn(0x7f13980a4fa0 msgr2=0x7f1398069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:58.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1397fff700 1 -- 172.21.15.115:0/4060925475 shutdown_connections 2023-09-29T23:04:58.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.913+0000 7f1397fff700 1 -- 172.21.15.115:0/4060925475 wait complete. 2023-09-29T23:04:58.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1397fff700 1 Processor -- start 2023-09-29T23:04:58.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1397fff700 1 -- start start 2023-09-29T23:04:58.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1397fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1398067240 0x7f13980b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:58.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1397fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f139806f360 0x7f13980a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:58.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1397fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f139809ccf0 0x7f139812cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:58.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1397fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1398139cd0 con 0x7f1398067240 2023-09-29T23:04:58.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1397fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1398139800 con 0x7f139809ccf0 2023-09-29T23:04:58.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1397fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13980a1590 con 0x7f139806f360 2023-09-29T23:04:58.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1396ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1398067240 0x7f13980b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:58.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f138e7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f139806f360 0x7f13980a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:58.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1396ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1398067240 0x7f13980b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49006/0 (socket says 172.21.15.115:49006) 2023-09-29T23:04:58.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1396ffd700 1 -- 172.21.15.115:0/1938213037 learned_addr learned my addr 172.21.15.115:0/1938213037 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:04:58.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f13977fe700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f139809ccf0 0x7f139812cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:58.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1396ffd700 1 -- 172.21.15.115:0/1938213037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f139806f360 msgr2=0x7f13980a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:58.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1396ffd700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f139806f360 0x7f13980a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1396ffd700 1 -- 172.21.15.115:0/1938213037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f139809ccf0 msgr2=0x7f139812cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:58.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1396ffd700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f139809ccf0 0x7f139812cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:58.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1396ffd700 1 -- 172.21.15.115:0/1938213037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380009420 con 0x7f1398067240 2023-09-29T23:04:58.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f13977fe700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f139809ccf0 0x7f139812cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:04:58.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1396ffd700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1398067240 0x7f13980b1400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f138800ea50 tx=0x7f1388009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:58.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f138f7fe700 1 -- 172.21.15.115:0/1938213037 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138800eee0 con 0x7f1398067240 2023-09-29T23:04:58.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f138f7fe700 1 -- 172.21.15.115:0/1938213037 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138800c850 con 0x7f1398067240 2023-09-29T23:04:58.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1397fff700 1 -- 172.21.15.115:0/1938213037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13980a1850 con 0x7f1398067240 2023-09-29T23:04:58.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f138f7fe700 1 -- 172.21.15.115:0/1938213037 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138800cbd0 con 0x7f1398067240 2023-09-29T23:04:58.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.917+0000 7f1397fff700 1 -- 172.21.15.115:0/1938213037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13981383e0 con 0x7f1398067240 2023-09-29T23:04:58.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.921+0000 7f1397fff700 1 -- 172.21.15.115:0/1938213037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13981399f0 con 0x7f1398067240 2023-09-29T23:04:58.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.921+0000 7f138f7fe700 1 -- 172.21.15.115:0/1938213037 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f1388013470 con 0x7f1398067240 2023-09-29T23:04:58.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.921+0000 7f138f7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:04:58.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.921+0000 7f138f7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:04:58.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.921+0000 7f138f7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:04:58.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.921+0000 7f138f7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:04:58.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.921+0000 7f138f7fe700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f137808e8b0 0x7f1378090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:58.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.921+0000 7f138f7fe700 1 -- 172.21.15.115:0/1938213037 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3467+0+0 (secure 0 0 0) 0x7f13880b4c90 con 0x7f1398067240 2023-09-29T23:04:58.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.925+0000 7f138e7fc700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f137808e8b0 0x7f1378090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:58.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.925+0000 7f138e7fc700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f137808e8b0 0x7f1378090d60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f13800093f0 tx=0x7f1380017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:58.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:58.929+0000 7f138f7fe700 1 -- 172.21.15.115:0/1938213037 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1388085ab0 con 0x7f1398067240 2023-09-29T23:04:59.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.089+0000 7f1397fff700 1 -- 172.21.15.115:0/1938213037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f13981399f0 con 0x7f1398067240 2023-09-29T23:04:59.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.793+0000 7f138f7fe700 1 -- 172.21.15.115:0/1938213037 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f13981399f0 con 0x7f1398067240 2023-09-29T23:04:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.797+0000 7f1397fff700 10 mgrc shutdown 2023-09-29T23:04:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.797+0000 7f1397fff700 1 -- 172.21.15.115:0/1938213037 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f137808e8b0 msgr2=0x7f1378090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.797+0000 7f1397fff700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f137808e8b0 0x7f1378090d60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f13800093f0 tx=0x7f1380017000 comp rx=0 tx=0).stop 2023-09-29T23:04:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.797+0000 7f1397fff700 1 -- 172.21.15.115:0/1938213037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1398067240 msgr2=0x7f13980b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.797+0000 7f1397fff700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1398067240 0x7f13980b1400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f138800ea50 tx=0x7f1388009250 comp rx=0 tx=0).stop 2023-09-29T23:04:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.797+0000 7f1397fff700 1 -- 172.21.15.115:0/1938213037 shutdown_connections 2023-09-29T23:04:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.797+0000 7f1397fff700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f139809ccf0 0x7f139812cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:59.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.797+0000 7f1397fff700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f139806f360 0x7f13980a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:59.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.797+0000 7f1397fff700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f137808e8b0 0x7f1378090d60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:59.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.797+0000 7f1397fff700 1 --2- 172.21.15.115:0/1938213037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1398067240 0x7f13980b1400 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:59.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.797+0000 7f1397fff700 1 -- 172.21.15.115:0/1938213037 >> 172.21.15.115:0/1938213037 conn(0x7f13980a4fa0 msgr2=0x7f139809e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:59.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.797+0000 7f1397fff700 1 -- 172.21.15.115:0/1938213037 shutdown_connections 2023-09-29T23:04:59.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.797+0000 7f1397fff700 1 -- 172.21.15.115:0/1938213037 wait complete. 2023-09-29T23:04:59.801 INFO:teuthology.orchestra.run.smithi115.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-29T23:04:59.812 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-29T23:04:59.812 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-29T23:04:59.813 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-29T23:04:59.815 INFO:tasks.ceph.mds.a:Started 2023-09-29T23:04:59.815 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-29T23:04:59.815 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-29T23:04:59.817 INFO:tasks.ceph.mds.c:Started 2023-09-29T23:04:59.817 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-29T23:04:59.817 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-29T23:04:59.820 INFO:tasks.ceph.mds.b:Started 2023-09-29T23:04:59.820 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-29T23:04:59.820 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:04:59.894 INFO:tasks.ceph.mds.c.smithi115.stdout:starting mds.c at 2023-09-29T23:04:59.898 INFO:tasks.ceph.mds.b.smithi156.stdout:starting mds.b at 2023-09-29T23:04:59.902 INFO:tasks.ceph.mds.a.smithi115.stdout:starting mds.a at 2023-09-29T23:04:59.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.933+0000 7fa6372d4700 1 Processor -- start 2023-09-29T23:04:59.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.933+0000 7fa6372d4700 1 -- start start 2023-09-29T23:04:59.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.933+0000 7fa6372d4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa6300b2fa0 0x7fa63006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:59.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.933+0000 7fa6372d4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa6300b3370 0x7fa630143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:59.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.933+0000 7fa6372d4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa63006e650 0x7fa630143130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:59.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.933+0000 7fa6372d4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63006f440 con 0x7fa6300b3370 2023-09-29T23:04:59.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.933+0000 7fa6372d4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63006f700 con 0x7fa6300b2fa0 2023-09-29T23:04:59.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.933+0000 7fa6372d4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa630143670 con 0x7fa63006e650 2023-09-29T23:04:59.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.933+0000 7fa63486f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa6300b3370 0x7fa630143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:59.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.933+0000 7fa63486f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa6300b3370 0x7fa630143bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49036/0 (socket says 172.21.15.115:49036) 2023-09-29T23:04:59.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.933+0000 7fa63486f700 1 -- 172.21.15.115:0/438780308 learned_addr learned my addr 172.21.15.115:0/438780308 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:04:59.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.933+0000 7fa635871700 1 --2- 172.21.15.115:0/438780308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa63006e650 0x7fa630143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:59.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.933+0000 7fa635070700 1 --2- 172.21.15.115:0/438780308 >> v2:172.21.15.156:3300/0 conn(0x7fa6300b2fa0 0x7fa63006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:59.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa63486f700 1 -- 172.21.15.115:0/438780308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa63006e650 msgr2=0x7fa630143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa63486f700 1 --2- 172.21.15.115:0/438780308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa63006e650 0x7fa630143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa63486f700 1 -- 172.21.15.115:0/438780308 >> v2:172.21.15.156:3300/0 conn(0x7fa6300b2fa0 msgr2=0x7fa63006ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:04:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa63486f700 1 --2- 172.21.15.115:0/438780308 >> v2:172.21.15.156:3300/0 conn(0x7fa6300b2fa0 0x7fa63006ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa63486f700 1 -- 172.21.15.115:0/438780308 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6300a4b80 con 0x7fa6300b3370 2023-09-29T23:04:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa635070700 1 --2- 172.21.15.115:0/438780308 >> v2:172.21.15.156:3300/0 conn(0x7fa6300b2fa0 0x7fa63006ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:04:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa63486f700 1 --2- 172.21.15.115:0/438780308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6300b3370 0x7fa630143bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa63006c3c0 tx=0x7fa620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71db0f54022cec5 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa627fff700 1 -- 172.21.15.115:0/438780308 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620009e70 con 0x7fa6300b3370 2023-09-29T23:04:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa627fff700 1 -- 172.21.15.115:0/438780308 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62000b860 con 0x7fa6300b3370 2023-09-29T23:04:59.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa627fff700 1 -- 172.21.15.115:0/438780308 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62000bc00 con 0x7fa6300b3370 2023-09-29T23:04:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa6372d4700 1 -- 172.21.15.115:0/438780308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6300b3370 msgr2=0x7fa630143bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:59.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa6372d4700 1 --2- 172.21.15.115:0/438780308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6300b3370 0x7fa630143bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa63006c3c0 tx=0x7fa620009250 comp rx=0 tx=0).stop 2023-09-29T23:04:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa6372d4700 1 -- 172.21.15.115:0/438780308 shutdown_connections 2023-09-29T23:04:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa6372d4700 1 --2- 172.21.15.115:0/438780308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa63006e650 0x7fa630143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa6372d4700 1 --2- 172.21.15.115:0/438780308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6300b3370 0x7fa630143bd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa6372d4700 1 --2- 172.21.15.115:0/438780308 >> v2:172.21.15.156:3300/0 conn(0x7fa6300b2fa0 0x7fa63006ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa6372d4700 1 -- 172.21.15.115:0/438780308 >> 172.21.15.115:0/438780308 conn(0x7fa630068a40 msgr2=0x7fa630068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:04:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa6372d4700 1 -- 172.21.15.115:0/438780308 shutdown_connections 2023-09-29T23:04:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa6372d4700 1 -- 172.21.15.115:0/438780308 wait complete. 2023-09-29T23:04:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa6372d4700 1 Processor -- start 2023-09-29T23:04:59.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.937+0000 7fa6372d4700 1 -- start start 2023-09-29T23:04:59.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa6372d4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa63006e650 0x7fa63009d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:59.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa6372d4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6300b2fa0 0x7fa63009eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:59.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa6372d4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6300b3370 0x7fa63014f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:59.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa6372d4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63009e0f0 con 0x7fa63006e650 2023-09-29T23:04:59.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa6372d4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63014f4d0 con 0x7fa6300b2fa0 2023-09-29T23:04:59.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa6372d4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63014f220 con 0x7fa6300b3370 2023-09-29T23:04:59.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa635070700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa63006e650 0x7fa63009d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:59.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa635871700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6300b3370 0x7fa63014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:59.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa635070700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa63006e650 0x7fa63009d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49038/0 (socket says 172.21.15.115:49038) 2023-09-29T23:04:59.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa635070700 1 -- 172.21.15.115:0/3099082400 learned_addr learned my addr 172.21.15.115:0/3099082400 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:04:59.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa63486f700 1 --2- 172.21.15.115:0/3099082400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6300b2fa0 0x7fa63009eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:59.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa635871700 1 -- 172.21.15.115:0/3099082400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6300b2fa0 msgr2=0x7fa63009eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:59.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa635871700 1 --2- 172.21.15.115:0/3099082400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6300b2fa0 0x7fa63009eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:59.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa635871700 1 -- 172.21.15.115:0/3099082400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa63006e650 msgr2=0x7fa63009d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:04:59.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa635871700 1 --2- 172.21.15.115:0/3099082400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa63006e650 0x7fa63009d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:04:59.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa635871700 1 -- 172.21.15.115:0/3099082400 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6200094f0 con 0x7fa6300b3370 2023-09-29T23:04:59.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa635871700 1 --2- 172.21.15.115:0/3099082400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6300b3370 0x7fa63014f770 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa628009e20 tx=0x7fa62800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:59.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa6257fa700 1 -- 172.21.15.115:0/3099082400 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62800cb50 con 0x7fa6300b3370 2023-09-29T23:04:59.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa6257fa700 1 -- 172.21.15.115:0/3099082400 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62800f040 con 0x7fa6300b3370 2023-09-29T23:04:59.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa6372d4700 1 -- 172.21.15.115:0/3099082400 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63009e3d0 con 0x7fa6300b3370 2023-09-29T23:04:59.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa6257fa700 1 -- 172.21.15.115:0/3099082400 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628014480 con 0x7fa6300b3370 2023-09-29T23:04:59.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa6372d4700 1 -- 172.21.15.115:0/3099082400 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63009b8a0 con 0x7fa6300b3370 2023-09-29T23:04:59.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.941+0000 7fa6372d4700 1 -- 172.21.15.115:0/3099082400 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa630070990 con 0x7fa6300b3370 2023-09-29T23:04:59.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.945+0000 7fa6257fa700 1 -- 172.21.15.115:0/3099082400 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fa6280147f0 con 0x7fa6300b3370 2023-09-29T23:04:59.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.945+0000 7fa6257fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:04:59.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.945+0000 7fa6257fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:04:59.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.945+0000 7fa6257fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:04:59.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.945+0000 7fa6257fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:04:59.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.945+0000 7fa6257fa700 1 --2- 172.21.15.115:0/3099082400 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa61408e8b0 0x7fa614090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:04:59.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.945+0000 7fa635070700 1 --2- 172.21.15.115:0/3099082400 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa61408e8b0 0x7fa614090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:04:59.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.945+0000 7fa6257fa700 1 -- 172.21.15.115:0/3099082400 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fa6280b4df0 con 0x7fa6300b3370 2023-09-29T23:04:59.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.945+0000 7fa635070700 1 --2- 172.21.15.115:0/3099082400 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa61408e8b0 0x7fa614090d60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa62c006dc0 tx=0x7fa62c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:04:59.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:04:59.953+0000 7fa6257fa700 1 -- 172.21.15.115:0/3099082400 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa628085c00 con 0x7fa6300b3370 2023-09-29T23:05:00.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.113+0000 7fa6372d4700 1 -- 172.21.15.115:0/3099082400 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6300a4ec0 con 0x7fa6300b3370 2023-09-29T23:05:00.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.113+0000 7fa6257fa700 1 -- 172.21.15.115:0/3099082400 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9002 (secure 0 0 0) 0x7fa628018070 con 0x7fa6300b3370 2023-09-29T23:05:00.117 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:00.117 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":15,"fsid":"593687ae-01c7-4a32-a91e-931db75fb751","created":"2023-09-29T23:04:48.574873+0000","modified":"2023-09-29T23:04:59.780478+0000","last_up_change":"2023-09-29T23:04:53.614158+0000","last_in_change":"2023-09-29T23:04:50.489116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-29T23:04:54.900033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-29T23:04:58.342574+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9da0e8c9-ea18-4691-87ef-fbf5502845a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":26662},{"type":"v1","addr":"172.21.15.115:6801","nonce":26662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":26662},{"type":"v1","addr":"172.21.15.115:6803","nonce":26662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":26662},{"type":"v1","addr":"172.21.15.115:6807","nonce":26662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":26662},{"type":"v1","addr":"172.21.15.115:6805","nonce":26662}]},"public_addr":"172.21.15.115:6801/26662","cluster_addr":"172.21.15.115:6803/26662","heartbeat_back_addr":"172.21.15.115:6807/26662","heartbeat_front_addr":"172.21.15.115:6805/26662","state":["exists","up"]},{"osd":1,"uuid":"eaaa380c-73da-4075-992d-ab16b36d8ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":26874},{"type":"v1","addr":"172.21.15.156:6801","nonce":26874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":26874},{"type":"v1","addr":"172.21.15.156:6803","nonce":26874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":26874},{"type":"v1","addr":"172.21.15.156:6807","nonce":26874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":26874},{"type":"v1","addr":"172.21.15.156:6805","nonce":26874}]},"public_addr":"172.21.15.156:6801/26874","cluster_addr":"172.21.15.156:6803/26874","heartbeat_back_addr":"172.21.15.156:6807/26874","heartbeat_front_addr":"172.21.15.156:6805/26874","state":["exists","up"]},{"osd":2,"uuid":"01e8286e-30af-41c7-bcd1-c4545f9f0a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":26873},{"type":"v1","addr":"172.21.15.156:6809","nonce":26873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":26873},{"type":"v1","addr":"172.21.15.156:6811","nonce":26873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":26873},{"type":"v1","addr":"172.21.15.156:6817","nonce":26873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":26873},{"type":"v1","addr":"172.21.15.156:6813","nonce":26873}]},"public_addr":"172.21.15.156:6809/26873","cluster_addr":"172.21.15.156:6811/26873","heartbeat_back_addr":"172.21.15.156:6817/26873","heartbeat_front_addr":"172.21.15.156:6813/26873","state":["exists","up"]},{"osd":3,"uuid":"4f6a1234-5ac6-43b0-baaa-3567ab7c73a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6815","nonce":26875},{"type":"v1","addr":"172.21.15.156:6816","nonce":26875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":26875},{"type":"v1","addr":"172.21.15.156:6819","nonce":26875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":26875},{"type":"v1","addr":"172.21.15.156:6823","nonce":26875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":26875},{"type":"v1","addr":"172.21.15.156:6821","nonce":26875}]},"public_addr":"172.21.15.156:6816/26875","cluster_addr":"172.21.15.156:6819/26875","heartbeat_back_addr":"172.21.15.156:6823/26875","heartbeat_front_addr":"172.21.15.156:6821/26875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.582513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.686413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:05:00.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.117+0000 7fa6372d4700 10 mgrc shutdown 2023-09-29T23:05:00.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.117+0000 7fa6372d4700 1 -- 172.21.15.115:0/3099082400 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa61408e8b0 msgr2=0x7fa614090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.117+0000 7fa6372d4700 1 --2- 172.21.15.115:0/3099082400 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa61408e8b0 0x7fa614090d60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa62c006dc0 tx=0x7fa62c008040 comp rx=0 tx=0).stop 2023-09-29T23:05:00.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.117+0000 7fa6372d4700 1 -- 172.21.15.115:0/3099082400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6300b3370 msgr2=0x7fa63014f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.117+0000 7fa6372d4700 1 --2- 172.21.15.115:0/3099082400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6300b3370 0x7fa63014f770 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa628009e20 tx=0x7fa62800b040 comp rx=0 tx=0).stop 2023-09-29T23:05:00.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.117+0000 7fa6372d4700 1 -- 172.21.15.115:0/3099082400 shutdown_connections 2023-09-29T23:05:00.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.117+0000 7fa6372d4700 1 --2- 172.21.15.115:0/3099082400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6300b3370 0x7fa63014f770 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.117+0000 7fa6372d4700 1 --2- 172.21.15.115:0/3099082400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6300b2fa0 0x7fa63009eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.117+0000 7fa6372d4700 1 --2- 172.21.15.115:0/3099082400 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa61408e8b0 0x7fa614090d60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.117+0000 7fa6372d4700 1 --2- 172.21.15.115:0/3099082400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa63006e650 0x7fa63009d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.117+0000 7fa6372d4700 1 -- 172.21.15.115:0/3099082400 >> 172.21.15.115:0/3099082400 conn(0x7fa630068a40 msgr2=0x7fa63006ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:00.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.117+0000 7fa6372d4700 1 -- 172.21.15.115:0/3099082400 shutdown_connections 2023-09-29T23:05:00.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.117+0000 7fa6372d4700 1 -- 172.21.15.115:0/3099082400 wait complete. 2023-09-29T23:05:00.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-29T23:04:54.900033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-29T23:04:58.342574+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-29T23:05:00.131 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-29T23:05:00.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe6451a6700 1 Processor -- start 2023-09-29T23:05:00.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe6451a6700 1 -- start start 2023-09-29T23:05:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe6451a6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe64006f860 0x7fe6400a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe6451a6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe64006fc30 0x7fe64006bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe6451a6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6400a5720 0x7fe64006b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe6451a6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64006c4a0 con 0x7fe64006fc30 2023-09-29T23:05:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe6451a6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6400a6fe0 con 0x7fe64006f860 2023-09-29T23:05:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe6451a6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400a6490 con 0x7fe6400a5720 2023-09-29T23:05:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe63f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe64006fc30 0x7fe64006bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe63f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe64006fc30 0x7fe64006bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49052/0 (socket says 172.21.15.115:49052) 2023-09-29T23:05:00.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe63f7fe700 1 -- 172.21.15.115:0/1716130105 learned_addr learned my addr 172.21.15.115:0/1716130105 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:00.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe6449a5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6400a5720 0x7fe64006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe63ffff700 1 --2- 172.21.15.115:0/1716130105 >> v2:172.21.15.156:3300/0 conn(0x7fe64006f860 0x7fe6400a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe63f7fe700 1 -- 172.21.15.115:0/1716130105 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6400a5720 msgr2=0x7fe64006b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:00.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe63f7fe700 1 --2- 172.21.15.115:0/1716130105 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6400a5720 0x7fe64006b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe63f7fe700 1 -- 172.21.15.115:0/1716130105 >> v2:172.21.15.156:3300/0 conn(0x7fe64006f860 msgr2=0x7fe6400a5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:00.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe63f7fe700 1 --2- 172.21.15.115:0/1716130105 >> v2:172.21.15.156:3300/0 conn(0x7fe64006f860 0x7fe6400a5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe63f7fe700 1 -- 172.21.15.115:0/1716130105 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6400a6750 con 0x7fe64006fc30 2023-09-29T23:05:00.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe63ffff700 1 --2- 172.21.15.115:0/1716130105 >> v2:172.21.15.156:3300/0 conn(0x7fe64006f860 0x7fe6400a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:00.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.237+0000 7fe63f7fe700 1 --2- 172.21.15.115:0/1716130105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe64006fc30 0x7fe64006bf60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe640065050 tx=0x7fe630009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c475d95b984e00f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:00.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe63effd700 1 -- 172.21.15.115:0/1716130105 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000e070 con 0x7fe64006fc30 2023-09-29T23:05:00.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe63effd700 1 -- 172.21.15.115:0/1716130105 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63000ba20 con 0x7fe64006fc30 2023-09-29T23:05:00.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe63effd700 1 -- 172.21.15.115:0/1716130105 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6300092e0 con 0x7fe64006fc30 2023-09-29T23:05:00.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 -- 172.21.15.115:0/1716130105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe64006fc30 msgr2=0x7fe64006bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 --2- 172.21.15.115:0/1716130105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe64006fc30 0x7fe64006bf60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe640065050 tx=0x7fe630009840 comp rx=0 tx=0).stop 2023-09-29T23:05:00.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 -- 172.21.15.115:0/1716130105 shutdown_connections 2023-09-29T23:05:00.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 --2- 172.21.15.115:0/1716130105 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6400a5720 0x7fe64006b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 --2- 172.21.15.115:0/1716130105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe64006fc30 0x7fe64006bf60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 --2- 172.21.15.115:0/1716130105 >> v2:172.21.15.156:3300/0 conn(0x7fe64006f860 0x7fe6400a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 -- 172.21.15.115:0/1716130105 >> 172.21.15.115:0/1716130105 conn(0x7fe640067b40 msgr2=0x7fe640067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:00.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 -- 172.21.15.115:0/1716130105 shutdown_connections 2023-09-29T23:05:00.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 -- 172.21.15.115:0/1716130105 wait complete. 2023-09-29T23:05:00.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 Processor -- start 2023-09-29T23:05:00.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 -- start start 2023-09-29T23:05:00.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe64006f860 0x7fe6400a3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe64006fc30 0x7fe640152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6400a5720 0x7fe64009b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64009c2e0 con 0x7fe6400a5720 2023-09-29T23:05:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe640153520 con 0x7fe64006f860 2023-09-29T23:05:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6451a6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6401537c0 con 0x7fe64006fc30 2023-09-29T23:05:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6449a5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6400a5720 0x7fe64009b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe63f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe64006fc30 0x7fe640152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6449a5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6400a5720 0x7fe64009b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49066/0 (socket says 172.21.15.115:49066) 2023-09-29T23:05:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.241+0000 7fe6449a5700 1 -- 172.21.15.115:0/1084964906 learned_addr learned my addr 172.21.15.115:0/1084964906 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.245+0000 7fe63ffff700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe64006f860 0x7fe6400a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.245+0000 7fe6449a5700 1 -- 172.21.15.115:0/1084964906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe64006fc30 msgr2=0x7fe640152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.245+0000 7fe6449a5700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe64006fc30 0x7fe640152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.245+0000 7fe6449a5700 1 -- 172.21.15.115:0/1084964906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe64006f860 msgr2=0x7fe6400a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.245+0000 7fe6449a5700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe64006f860 0x7fe6400a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.245+0000 7fe6449a5700 1 -- 172.21.15.115:0/1084964906 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe630009ae0 con 0x7fe6400a5720 2023-09-29T23:05:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.245+0000 7fe63f7fe700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe64006fc30 0x7fe640152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.245+0000 7fe6449a5700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6400a5720 0x7fe64009b560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe63800e8d0 tx=0x7fe6380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.245+0000 7fe637fff700 1 -- 172.21.15.115:0/1084964906 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe638013680 con 0x7fe6400a5720 2023-09-29T23:05:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.245+0000 7fe637fff700 1 -- 172.21.15.115:0/1084964906 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6380137e0 con 0x7fe6400a5720 2023-09-29T23:05:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.245+0000 7fe6451a6700 1 -- 172.21.15.115:0/1084964906 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6400a3980 con 0x7fe6400a5720 2023-09-29T23:05:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.245+0000 7fe637fff700 1 -- 172.21.15.115:0/1084964906 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe638013ba0 con 0x7fe6400a5720 2023-09-29T23:05:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.245+0000 7fe6451a6700 1 -- 172.21.15.115:0/1084964906 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe640136a10 con 0x7fe6400a5720 2023-09-29T23:05:00.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.249+0000 7fe637fff700 1 -- 172.21.15.115:0/1084964906 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fe6380123d0 con 0x7fe6400a5720 2023-09-29T23:05:00.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.249+0000 7fe637fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:00.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.249+0000 7fe6451a6700 1 -- 172.21.15.115:0/1084964906 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe640136c60 con 0x7fe6400a5720 2023-09-29T23:05:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.249+0000 7fe637fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.249+0000 7fe637fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.249+0000 7fe637fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.249+0000 7fe637fff700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe62008e930 0x7fe620090de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.249+0000 7fe63ffff700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe62008e930 0x7fe620090de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.249+0000 7fe637fff700 1 -- 172.21.15.115:0/1084964906 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fe6380b48d0 con 0x7fe6400a5720 2023-09-29T23:05:00.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.253+0000 7fe63ffff700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe62008e930 0x7fe620090de0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe628006f00 tx=0x7fe628008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:00.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.257+0000 7fe637fff700 1 -- 172.21.15.115:0/1084964906 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe638085640 con 0x7fe6400a5720 2023-09-29T23:05:00.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.413+0000 7fe6451a6700 1 -- 172.21.15.115:0/1084964906 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe64004be00 con 0x7fe6400a5720 2023-09-29T23:05:00.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.413+0000 7fe637fff700 1 -- 172.21.15.115:0/1084964906 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6380210a0 con 0x7fe6400a5720 2023-09-29T23:05:00.417 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-09-29T23:05:00.419 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.417+0000 7fe6451a6700 10 mgrc shutdown 2023-09-29T23:05:00.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.417+0000 7fe6451a6700 1 -- 172.21.15.115:0/1084964906 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe62008e930 msgr2=0x7fe620090de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.417+0000 7fe6451a6700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe62008e930 0x7fe620090de0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe628006f00 tx=0x7fe628008040 comp rx=0 tx=0).stop 2023-09-29T23:05:00.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.417+0000 7fe6451a6700 1 -- 172.21.15.115:0/1084964906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6400a5720 msgr2=0x7fe64009b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.417+0000 7fe6451a6700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6400a5720 0x7fe64009b560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe63800e8d0 tx=0x7fe6380091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.417+0000 7fe6451a6700 1 -- 172.21.15.115:0/1084964906 shutdown_connections 2023-09-29T23:05:00.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.417+0000 7fe6451a6700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe62008e930 0x7fe620090de0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.417+0000 7fe6451a6700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6400a5720 0x7fe64009b560 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.417+0000 7fe6451a6700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe64006fc30 0x7fe640152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.417+0000 7fe6451a6700 1 --2- 172.21.15.115:0/1084964906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe64006f860 0x7fe6400a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.417+0000 7fe6451a6700 1 -- 172.21.15.115:0/1084964906 >> 172.21.15.115:0/1084964906 conn(0x7fe640067b40 msgr2=0x7fe640069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:00.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.417+0000 7fe6451a6700 1 -- 172.21.15.115:0/1084964906 shutdown_connections 2023-09-29T23:05:00.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.417+0000 7fe6451a6700 1 -- 172.21.15.115:0/1084964906 wait complete. 2023-09-29T23:05:00.431 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-29T23:05:00.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f7945028700 1 Processor -- start 2023-09-29T23:05:00.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f7945028700 1 -- start start 2023-09-29T23:05:00.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f7945028700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7940068ce0 0x7f7940147380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f7945028700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79400b6d30 0x7f7940147d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f7945028700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79400a01c0 con 0x7f79400b4850 2023-09-29T23:05:00.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f7945028700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79400690b0 con 0x7f79400b6d30 2023-09-29T23:05:00.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f7945028700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7940148270 con 0x7f7940068ce0 2023-09-29T23:05:00.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f793f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f79400b6d30 0x7f7940147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f7944827700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f79400b4850 0x7f7940139df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42598/0 (socket says 172.21.15.115:42598) 2023-09-29T23:05:00.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f7944827700 1 -- 172.21.15.115:0/3429903012 learned_addr learned my addr 172.21.15.115:0/3429903012 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:00.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f793ffff700 1 --2- 172.21.15.115:0/3429903012 >> v2:172.21.15.156:3300/0 conn(0x7f7940068ce0 0x7f7940147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f793f7fe700 1 -- 172.21.15.115:0/3429903012 >> v2:172.21.15.156:3300/0 conn(0x7f7940068ce0 msgr2=0x7f7940147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:00.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f793f7fe700 1 --2- 172.21.15.115:0/3429903012 >> v2:172.21.15.156:3300/0 conn(0x7f7940068ce0 0x7f7940147380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f793f7fe700 1 -- 172.21.15.115:0/3429903012 >> v1:172.21.15.115:6789/0 conn(0x7f79400b4850 legacy=0x7f7940139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f793effd700 1 -- 172.21.15.115:0/3429903012 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705081453 0 0) 0x7f79400a01c0 con 0x7f79400b4850 2023-09-29T23:05:00.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f793f7fe700 1 -- 172.21.15.115:0/3429903012 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79401478c0 con 0x7f79400b6d30 2023-09-29T23:05:00.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f793f7fe700 1 --2- 172.21.15.115:0/3429903012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400b6d30 0x7f7940147d30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f79400b7170 tx=0x7f79280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e74da4bf9833b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:00.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.537+0000 7f793effd700 1 -- 172.21.15.115:0/3429903012 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928011630 con 0x7f79400b6d30 2023-09-29T23:05:00.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.541+0000 7f793effd700 1 -- 172.21.15.115:0/3429903012 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7928011790 con 0x7f79400b6d30 2023-09-29T23:05:00.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.541+0000 7f793effd700 1 -- 172.21.15.115:0/3429903012 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928011b30 con 0x7f79400b6d30 2023-09-29T23:05:00.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.541+0000 7f7945028700 1 -- 172.21.15.115:0/3429903012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400b6d30 msgr2=0x7f7940147d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.541+0000 7f7945028700 1 --2- 172.21.15.115:0/3429903012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400b6d30 0x7f7940147d30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f79400b7170 tx=0x7f79280091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.541+0000 7f7945028700 1 -- 172.21.15.115:0/3429903012 shutdown_connections 2023-09-29T23:05:00.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.541+0000 7f7945028700 1 --2- 172.21.15.115:0/3429903012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400b6d30 0x7f7940147d30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.541+0000 7f7945028700 1 --2- 172.21.15.115:0/3429903012 >> v2:172.21.15.156:3300/0 conn(0x7f7940068ce0 0x7f7940147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.541+0000 7f7945028700 1 -- 172.21.15.115:0/3429903012 >> 172.21.15.115:0/3429903012 conn(0x7f7940069520 msgr2=0x7f79400683a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:00.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.541+0000 7f7945028700 1 -- 172.21.15.115:0/3429903012 shutdown_connections 2023-09-29T23:05:00.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.541+0000 7f7945028700 1 -- 172.21.15.115:0/3429903012 wait complete. 2023-09-29T23:05:00.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.541+0000 7f7945028700 1 Processor -- start 2023-09-29T23:05:00.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.541+0000 7f7945028700 1 -- start start 2023-09-29T23:05:00.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f7945028700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7940068ce0 0x7f79400a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f7945028700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79400b4850 0x7f794006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f7945028700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400b6d30 0x7f7940152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f7945028700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794006b180 con 0x7f79400b6d30 2023-09-29T23:05:00.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f7945028700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7940153a50 con 0x7f79400b4850 2023-09-29T23:05:00.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f7945028700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7940153d10 con 0x7f7940068ce0 2023-09-29T23:05:00.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f793ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7940068ce0 0x7f79400a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f7944827700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400b6d30 0x7f7940152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f793ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7940068ce0 0x7f79400a51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:38910/0 (socket says 172.21.15.115:38910) 2023-09-29T23:05:00.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f793ffff700 1 -- 172.21.15.115:0/409606023 learned_addr learned my addr 172.21.15.115:0/409606023 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:00.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f793f7fe700 1 --2- 172.21.15.115:0/409606023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79400b4850 0x7f794006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f793ffff700 1 -- 172.21.15.115:0/409606023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79400b4850 msgr2=0x7f794006b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f793ffff700 1 --2- 172.21.15.115:0/409606023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79400b4850 0x7f794006b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f793ffff700 1 -- 172.21.15.115:0/409606023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400b6d30 msgr2=0x7f7940152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f793ffff700 1 --2- 172.21.15.115:0/409606023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400b6d30 0x7f7940152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f793ffff700 1 -- 172.21.15.115:0/409606023 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928009420 con 0x7f7940068ce0 2023-09-29T23:05:00.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f793ffff700 1 --2- 172.21.15.115:0/409606023 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7940068ce0 0x7f79400a51a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7930009f20 tx=0x7f793000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:00.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f7937fff700 1 -- 172.21.15.115:0/409606023 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793000cbd0 con 0x7f7940068ce0 2023-09-29T23:05:00.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f7937fff700 1 -- 172.21.15.115:0/409606023 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793000f040 con 0x7f7940068ce0 2023-09-29T23:05:00.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f7945028700 1 -- 172.21.15.115:0/409606023 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7940153fd0 con 0x7f7940068ce0 2023-09-29T23:05:00.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f7937fff700 1 -- 172.21.15.115:0/409606023 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930014480 con 0x7f7940068ce0 2023-09-29T23:05:00.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f7945028700 1 -- 172.21.15.115:0/409606023 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794006bb30 con 0x7f7940068ce0 2023-09-29T23:05:00.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.545+0000 7f7945028700 1 -- 172.21.15.115:0/409606023 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794004be00 con 0x7f7940068ce0 2023-09-29T23:05:00.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.549+0000 7f7937fff700 1 -- 172.21.15.115:0/409606023 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f79300147f0 con 0x7f7940068ce0 2023-09-29T23:05:00.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.549+0000 7f7937fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:00.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.549+0000 7f7937fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:00.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.549+0000 7f7937fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:00.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.549+0000 7f7937fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:00.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.549+0000 7f7937fff700 1 --2- 172.21.15.115:0/409606023 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f792008e930 0x7f7920090de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.549+0000 7f7937fff700 1 -- 172.21.15.115:0/409606023 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f79300b4e90 con 0x7f7940068ce0 2023-09-29T23:05:00.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.549+0000 7f793f7fe700 1 --2- 172.21.15.115:0/409606023 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f792008e930 0x7f7920090de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.549+0000 7f793f7fe700 1 --2- 172.21.15.115:0/409606023 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f792008e930 0x7f7920090de0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f79400b7140 tx=0x7f7928017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:00.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.557+0000 7f7937fff700 1 -- 172.21.15.115:0/409606023 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7930085c00 con 0x7f7940068ce0 2023-09-29T23:05:00.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.721+0000 7f7945028700 1 -- 172.21.15.115:0/409606023 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f79400a25c0 con 0x7f7940068ce0 2023-09-29T23:05:00.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.721+0000 7f7937fff700 1 -- 172.21.15.115:0/409606023 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7930089220 con 0x7f7940068ce0 2023-09-29T23:05:00.725 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-09-29T23:05:00.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.725+0000 7f7945028700 10 mgrc shutdown 2023-09-29T23:05:00.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.725+0000 7f7945028700 1 -- 172.21.15.115:0/409606023 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f792008e930 msgr2=0x7f7920090de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.725+0000 7f7945028700 1 --2- 172.21.15.115:0/409606023 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f792008e930 0x7f7920090de0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f79400b7140 tx=0x7f7928017000 comp rx=0 tx=0).stop 2023-09-29T23:05:00.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.725+0000 7f7945028700 1 -- 172.21.15.115:0/409606023 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7940068ce0 msgr2=0x7f79400a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.725+0000 7f7945028700 1 --2- 172.21.15.115:0/409606023 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7940068ce0 0x7f79400a51a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7930009f20 tx=0x7f793000b040 comp rx=0 tx=0).stop 2023-09-29T23:05:00.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.725+0000 7f7945028700 1 -- 172.21.15.115:0/409606023 shutdown_connections 2023-09-29T23:05:00.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.725+0000 7f7945028700 1 --2- 172.21.15.115:0/409606023 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f792008e930 0x7f7920090de0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.725+0000 7f7945028700 1 --2- 172.21.15.115:0/409606023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f79400b6d30 0x7f7940152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.725+0000 7f7945028700 1 --2- 172.21.15.115:0/409606023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79400b4850 0x7f794006b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.725+0000 7f7945028700 1 --2- 172.21.15.115:0/409606023 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7940068ce0 0x7f79400a51a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.725+0000 7f7945028700 1 -- 172.21.15.115:0/409606023 >> 172.21.15.115:0/409606023 conn(0x7f7940069520 msgr2=0x7f79400b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:00.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.725+0000 7f7945028700 1 -- 172.21.15.115:0/409606023 shutdown_connections 2023-09-29T23:05:00.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.725+0000 7f7945028700 1 -- 172.21.15.115:0/409606023 wait complete. 2023-09-29T23:05:00.738 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-29T23:05:00.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f9639e9e700 1 Processor -- start 2023-09-29T23:05:00.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f9639e9e700 1 -- start start 2023-09-29T23:05:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f9639e9e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96340a36a0 0x7f963409c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f9639e9e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f96340a0f50 0x7f9634147090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f9639e9e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963413c680 con 0x7f96340a32d0 2023-09-29T23:05:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f9639e9e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f963413fd50 con 0x7f96340a0f50 2023-09-29T23:05:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f9639e9e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963413fff0 con 0x7f96340a36a0 2023-09-29T23:05:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f9638e9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f96340a32d0 0x7f963409e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42614/0 (socket says 172.21.15.115:42614) 2023-09-29T23:05:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f9638e9c700 1 -- 172.21.15.115:0/2657987901 learned_addr learned my addr 172.21.15.115:0/2657987901 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f9633fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96340a36a0 0x7f963409c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f963969d700 1 --2- 172.21.15.115:0/2657987901 >> v2:172.21.15.115:3300/0 conn(0x7f96340a0f50 0x7f9634147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f96337fe700 1 -- 172.21.15.115:0/2657987901 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734686240 0 0) 0x7f963413c680 con 0x7f96340a32d0 2023-09-29T23:05:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f96337fe700 1 -- 172.21.15.115:0/2657987901 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f961c003570 con 0x7f96340a32d0 2023-09-29T23:05:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f963969d700 1 -- 172.21.15.115:0/2657987901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96340a36a0 msgr2=0x7f963409c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f963969d700 1 --2- 172.21.15.115:0/2657987901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96340a36a0 0x7f963409c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f963969d700 1 -- 172.21.15.115:0/2657987901 >> v1:172.21.15.115:6789/0 conn(0x7f96340a32d0 legacy=0x7f963409e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f963969d700 1 -- 172.21.15.115:0/2657987901 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9634140290 con 0x7f96340a0f50 2023-09-29T23:05:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f963969d700 1 --2- 172.21.15.115:0/2657987901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96340a0f50 0x7f9634147090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f96240098e0 tx=0x7f96240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b3e914544748d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:00.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f96337fe700 1 -- 172.21.15.115:0/2657987901 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624011630 con 0x7f96340a0f50 2023-09-29T23:05:00.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f96337fe700 1 -- 172.21.15.115:0/2657987901 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9624011790 con 0x7f96340a0f50 2023-09-29T23:05:00.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.845+0000 7f96337fe700 1 -- 172.21.15.115:0/2657987901 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624011b10 con 0x7f96340a0f50 2023-09-29T23:05:00.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 -- 172.21.15.115:0/2657987901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96340a0f50 msgr2=0x7f9634147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 --2- 172.21.15.115:0/2657987901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96340a0f50 0x7f9634147090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f96240098e0 tx=0x7f96240091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 -- 172.21.15.115:0/2657987901 shutdown_connections 2023-09-29T23:05:00.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 --2- 172.21.15.115:0/2657987901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96340a0f50 0x7f9634147090 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 --2- 172.21.15.115:0/2657987901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96340a36a0 0x7f963409c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 -- 172.21.15.115:0/2657987901 >> 172.21.15.115:0/2657987901 conn(0x7f96340b1d20 msgr2=0x7f96340b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:00.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 -- 172.21.15.115:0/2657987901 shutdown_connections 2023-09-29T23:05:00.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 -- 172.21.15.115:0/2657987901 wait complete. 2023-09-29T23:05:00.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 Processor -- start 2023-09-29T23:05:00.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 -- start start 2023-09-29T23:05:00.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96340a0f50 0x7f963413ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96340a32d0 0x7f963406cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96340a36a0 0x7f963413b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963413fb50 con 0x7f96340a32d0 2023-09-29T23:05:00.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963406dad0 con 0x7f96340a36a0 2023-09-29T23:05:00.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963406dd90 con 0x7f96340a0f50 2023-09-29T23:05:00.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9633fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96340a32d0 0x7f963406cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9633fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96340a32d0 0x7f963406cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49098/0 (socket says 172.21.15.115:49098) 2023-09-29T23:05:00.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9638e9c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96340a0f50 0x7f963413ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9633fff700 1 -- 172.21.15.115:0/1652600038 learned_addr learned my addr 172.21.15.115:0/1652600038 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:00.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f963969d700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96340a36a0 0x7f963413b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9633fff700 1 -- 172.21.15.115:0/1652600038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96340a0f50 msgr2=0x7f963413ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9633fff700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96340a0f50 0x7f963413ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9633fff700 1 -- 172.21.15.115:0/1652600038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96340a36a0 msgr2=0x7f963413b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:00.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9633fff700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96340a36a0 0x7f963413b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:00.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9633fff700 1 -- 172.21.15.115:0/1652600038 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9624009420 con 0x7f96340a32d0 2023-09-29T23:05:00.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f963969d700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96340a36a0 0x7f963413b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:05:00.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9633fff700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96340a32d0 0x7f963406cb20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f962800ec50 tx=0x7f96280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:00.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9630ff9700 1 -- 172.21.15.115:0/1652600038 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800c850 con 0x7f96340a32d0 2023-09-29T23:05:00.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9630ff9700 1 -- 172.21.15.115:0/1652600038 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962800c9b0 con 0x7f96340a32d0 2023-09-29T23:05:00.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 -- 172.21.15.115:0/1652600038 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f963406f460 con 0x7f96340a32d0 2023-09-29T23:05:00.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9630ff9700 1 -- 172.21.15.115:0/1652600038 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800cd70 con 0x7f96340a32d0 2023-09-29T23:05:00.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.849+0000 7f9639e9e700 1 -- 172.21.15.115:0/1652600038 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963406d200 con 0x7f96340a32d0 2023-09-29T23:05:00.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.853+0000 7f9639e9e700 1 -- 172.21.15.115:0/1652600038 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963404be00 con 0x7f96340a32d0 2023-09-29T23:05:00.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.853+0000 7f9630ff9700 1 -- 172.21.15.115:0/1652600038 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f9628013680 con 0x7f96340a32d0 2023-09-29T23:05:00.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.853+0000 7f9630ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:00.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.853+0000 7f9630ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:00.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.853+0000 7f9630ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:00.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.853+0000 7f9630ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:00.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.853+0000 7f9630ff9700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f962008e8b0 0x7f9620090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:00.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.853+0000 7f9630ff9700 1 -- 172.21.15.115:0/1652600038 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f96280b4b60 con 0x7f96340a32d0 2023-09-29T23:05:00.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.857+0000 7f9638e9c700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f962008e8b0 0x7f9620090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:00.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.857+0000 7f9638e9c700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f962008e8b0 0x7f9620090d60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f962c005c50 tx=0x7f962c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:00.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:00.857+0000 7f9630ff9700 1 -- 172.21.15.115:0/1652600038 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9628085970 con 0x7f96340a32d0 2023-09-29T23:05:01.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.053+0000 7f9639e9e700 1 -- 172.21.15.115:0/1652600038 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f963406f5f0 con 0x7f96340a32d0 2023-09-29T23:05:01.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.053+0000 7f9630ff9700 1 -- 172.21.15.115:0/1652600038 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2777 (secure 0 0 0) 0x7f9628021090 con 0x7f96340a32d0 2023-09-29T23:05:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:01.055 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6809/3467795815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3467795815},{"type":"v1","addr":"172.21.15.115:6809","nonce":3467795815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6827/1953687175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1953687175},{"type":"v1","addr":"172.21.15.156:6827","nonce":1953687175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6811/1121307601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1121307601},{"type":"v1","addr":"172.21.15.115:6811","nonce":1121307601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-09-29T23:05:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.053+0000 7f9639e9e700 10 mgrc shutdown 2023-09-29T23:05:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.053+0000 7f9639e9e700 1 -- 172.21.15.115:0/1652600038 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f962008e8b0 msgr2=0x7f9620090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.053+0000 7f9639e9e700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f962008e8b0 0x7f9620090d60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f962c005c50 tx=0x7f962c009040 comp rx=0 tx=0).stop 2023-09-29T23:05:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.053+0000 7f9639e9e700 1 -- 172.21.15.115:0/1652600038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96340a32d0 msgr2=0x7f963406cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.053+0000 7f9639e9e700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96340a32d0 0x7f963406cb20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f962800ec50 tx=0x7f96280091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.053+0000 7f9639e9e700 1 -- 172.21.15.115:0/1652600038 shutdown_connections 2023-09-29T23:05:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.053+0000 7f9639e9e700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96340a36a0 0x7f963413b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.053+0000 7f9639e9e700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f962008e8b0 0x7f9620090d60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.053+0000 7f9639e9e700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96340a32d0 0x7f963406cb20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.053+0000 7f9639e9e700 1 --2- 172.21.15.115:0/1652600038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f96340a0f50 0x7f963413ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.053+0000 7f9639e9e700 1 -- 172.21.15.115:0/1652600038 >> 172.21.15.115:0/1652600038 conn(0x7f96340b1d20 msgr2=0x7f96340b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.057+0000 7f9639e9e700 1 -- 172.21.15.115:0/1652600038 shutdown_connections 2023-09-29T23:05:01.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.057+0000 7f9639e9e700 1 -- 172.21.15.115:0/1652600038 wait complete. 2023-09-29T23:05:01.059 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 3 2023-09-29T23:05:01.069 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:05:01.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.165+0000 7fb725aa0700 1 Processor -- start 2023-09-29T23:05:01.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.165+0000 7fb725aa0700 1 -- start start 2023-09-29T23:05:01.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.165+0000 7fb725aa0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb720068130 0x7fb72014f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.165+0000 7fb725aa0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7200a3710 con 0x7fb7200670a0 2023-09-29T23:05:01.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.165+0000 7fb725aa0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72009bd40 con 0x7fb7200a4140 2023-09-29T23:05:01.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.165+0000 7fb725aa0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7200a4510 con 0x7fb720068130 2023-09-29T23:05:01.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb71ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb7200670a0 0x7fb720067a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42628/0 (socket says 172.21.15.115:42628) 2023-09-29T23:05:01.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb71ffff700 1 -- 172.21.15.115:0/2326473888 learned_addr learned my addr 172.21.15.115:0/2326473888 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:01.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb72529f700 1 --2- 172.21.15.115:0/2326473888 >> v2:172.21.15.156:3300/0 conn(0x7fb720068130 0x7fb72014f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb71f7fe700 1 -- 172.21.15.115:0/2326473888 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869696730 0 0) 0x7fb7200a3710 con 0x7fb7200670a0 2023-09-29T23:05:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb71f7fe700 1 -- 172.21.15.115:0/2326473888 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb710003570 con 0x7fb7200670a0 2023-09-29T23:05:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb71f7fe700 1 -- 172.21.15.115:0/2326473888 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263441799 0 0) 0x7fb72009bd40 con 0x7fb7200a4140 2023-09-29T23:05:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb71f7fe700 1 -- 172.21.15.115:0/2326473888 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7200a3710 con 0x7fb7200a4140 2023-09-29T23:05:01.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb72529f700 1 -- 172.21.15.115:0/2326473888 >> v1:172.21.15.156:6789/0 conn(0x7fb7200a4140 legacy=0x7fb72009d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb72529f700 1 -- 172.21.15.115:0/2326473888 >> v1:172.21.15.115:6789/0 conn(0x7fb7200670a0 legacy=0x7fb720067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb72529f700 1 -- 172.21.15.115:0/2326473888 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7200686b0 con 0x7fb720068130 2023-09-29T23:05:01.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb72529f700 1 --2- 172.21.15.115:0/2326473888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb720068130 0x7fb72014f7d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb718009e60 tx=0x7fb718009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=171fc55a712cb508 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:01.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb71f7fe700 1 -- 172.21.15.115:0/2326473888 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71800e070 con 0x7fb720068130 2023-09-29T23:05:01.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb71f7fe700 1 -- 172.21.15.115:0/2326473888 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71800bb40 con 0x7fb720068130 2023-09-29T23:05:01.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb71f7fe700 1 -- 172.21.15.115:0/2326473888 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718012430 con 0x7fb720068130 2023-09-29T23:05:01.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb725aa0700 1 -- 172.21.15.115:0/2326473888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb720068130 msgr2=0x7fb72014f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb725aa0700 1 --2- 172.21.15.115:0/2326473888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb720068130 0x7fb72014f7d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb718009e60 tx=0x7fb718009780 comp rx=0 tx=0).stop 2023-09-29T23:05:01.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb725aa0700 1 -- 172.21.15.115:0/2326473888 shutdown_connections 2023-09-29T23:05:01.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb725aa0700 1 --2- 172.21.15.115:0/2326473888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb720068130 0x7fb72014f7d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb725aa0700 1 -- 172.21.15.115:0/2326473888 >> 172.21.15.115:0/2326473888 conn(0x7fb7200b1d20 msgr2=0x7fb7200b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:01.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb725aa0700 1 -- 172.21.15.115:0/2326473888 shutdown_connections 2023-09-29T23:05:01.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb725aa0700 1 -- 172.21.15.115:0/2326473888 wait complete. 2023-09-29T23:05:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.169+0000 7fb725aa0700 1 Processor -- start 2023-09-29T23:05:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb725aa0700 1 -- start start 2023-09-29T23:05:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb725aa0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7200670a0 0x7fb7201436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb725aa0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb720068130 0x7fb72006d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb725aa0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7200a4140 0x7fb72013b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb725aa0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72006cd90 con 0x7fb7200670a0 2023-09-29T23:05:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb725aa0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb720144140 con 0x7fb7200a4140 2023-09-29T23:05:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb725aa0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201443e0 con 0x7fb720068130 2023-09-29T23:05:01.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb724a9e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7200670a0 0x7fb7201436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb724a9e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7200670a0 0x7fb7201436c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49106/0 (socket says 172.21.15.115:49106) 2023-09-29T23:05:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb724a9e700 1 -- 172.21.15.115:0/334521927 learned_addr learned my addr 172.21.15.115:0/334521927 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb71ffff700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb720068130 0x7fb72006d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb72529f700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7200a4140 0x7fb72013b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb724a9e700 1 -- 172.21.15.115:0/334521927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb720068130 msgr2=0x7fb72006d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb724a9e700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb720068130 0x7fb72006d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb724a9e700 1 -- 172.21.15.115:0/334521927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7200a4140 msgr2=0x7fb72013b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb724a9e700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7200a4140 0x7fb72013b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb724a9e700 1 -- 172.21.15.115:0/334521927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718009a20 con 0x7fb7200670a0 2023-09-29T23:05:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb72529f700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7200a4140 0x7fb72013b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:05:01.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb724a9e700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7200670a0 0x7fb7201436c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb71400c580 tx=0x7fb714007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:01.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb71cff9700 1 -- 172.21.15.115:0/334521927 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714010510 con 0x7fb7200670a0 2023-09-29T23:05:01.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb71cff9700 1 -- 172.21.15.115:0/334521927 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb714010670 con 0x7fb7200670a0 2023-09-29T23:05:01.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb725aa0700 1 -- 172.21.15.115:0/334521927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72009ce20 con 0x7fb7200670a0 2023-09-29T23:05:01.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb71cff9700 1 -- 172.21.15.115:0/334521927 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714010a30 con 0x7fb7200670a0 2023-09-29T23:05:01.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb725aa0700 1 -- 172.21.15.115:0/334521927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb720143c00 con 0x7fb7200670a0 2023-09-29T23:05:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.173+0000 7fb725aa0700 1 -- 172.21.15.115:0/334521927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb720143eb0 con 0x7fb7200670a0 2023-09-29T23:05:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.177+0000 7fb71cff9700 1 -- 172.21.15.115:0/334521927 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fb71401b400 con 0x7fb7200670a0 2023-09-29T23:05:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.177+0000 7fb71cff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.177+0000 7fb71cff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.177+0000 7fb71cff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.177+0000 7fb71cff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.177+0000 7fb71cff9700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb70408e8e0 0x7fb704090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.177+0000 7fb71ffff700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb70408e8e0 0x7fb704090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.177+0000 7fb71cff9700 1 -- 172.21.15.115:0/334521927 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fb7140b4190 con 0x7fb7200670a0 2023-09-29T23:05:01.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.177+0000 7fb71ffff700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb70408e8e0 0x7fb704090d90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb720144790 tx=0x7fb70c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:01.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.181+0000 7fb71cff9700 1 -- 172.21.15.115:0/334521927 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb714084f10 con 0x7fb7200670a0 2023-09-29T23:05:01.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.341+0000 7fb725aa0700 1 -- 172.21.15.115:0/334521927 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb72004be00 con 0x7fb7200670a0 2023-09-29T23:05:01.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb71cff9700 1 -- 172.21.15.115:0/334521927 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8989 (secure 0 0 0) 0x7fb714088530 con 0x7fb7200670a0 2023-09-29T23:05:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:01.347 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":16,"fsid":"593687ae-01c7-4a32-a91e-931db75fb751","created":"2023-09-29T23:04:48.574873+0000","modified":"2023-09-29T23:05:00.788971+0000","last_up_change":"2023-09-29T23:04:53.614158+0000","last_in_change":"2023-09-29T23:04:50.489116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-29T23:04:54.900033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-29T23:04:58.342574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9da0e8c9-ea18-4691-87ef-fbf5502845a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":26662},{"type":"v1","addr":"172.21.15.115:6801","nonce":26662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":26662},{"type":"v1","addr":"172.21.15.115:6803","nonce":26662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":26662},{"type":"v1","addr":"172.21.15.115:6807","nonce":26662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":26662},{"type":"v1","addr":"172.21.15.115:6805","nonce":26662}]},"public_addr":"172.21.15.115:6801/26662","cluster_addr":"172.21.15.115:6803/26662","heartbeat_back_addr":"172.21.15.115:6807/26662","heartbeat_front_addr":"172.21.15.115:6805/26662","state":["exists","up"]},{"osd":1,"uuid":"eaaa380c-73da-4075-992d-ab16b36d8ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":26874},{"type":"v1","addr":"172.21.15.156:6801","nonce":26874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":26874},{"type":"v1","addr":"172.21.15.156:6803","nonce":26874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":26874},{"type":"v1","addr":"172.21.15.156:6807","nonce":26874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":26874},{"type":"v1","addr":"172.21.15.156:6805","nonce":26874}]},"public_addr":"172.21.15.156:6801/26874","cluster_addr":"172.21.15.156:6803/26874","heartbeat_back_addr":"172.21.15.156:6807/26874","heartbeat_front_addr":"172.21.15.156:6805/26874","state":["exists","up"]},{"osd":2,"uuid":"01e8286e-30af-41c7-bcd1-c4545f9f0a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":26873},{"type":"v1","addr":"172.21.15.156:6809","nonce":26873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":26873},{"type":"v1","addr":"172.21.15.156:6811","nonce":26873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":26873},{"type":"v1","addr":"172.21.15.156:6817","nonce":26873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":26873},{"type":"v1","addr":"172.21.15.156:6813","nonce":26873}]},"public_addr":"172.21.15.156:6809/26873","cluster_addr":"172.21.15.156:6811/26873","heartbeat_back_addr":"172.21.15.156:6817/26873","heartbeat_front_addr":"172.21.15.156:6813/26873","state":["exists","up"]},{"osd":3,"uuid":"4f6a1234-5ac6-43b0-baaa-3567ab7c73a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6815","nonce":26875},{"type":"v1","addr":"172.21.15.156:6816","nonce":26875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":26875},{"type":"v1","addr":"172.21.15.156:6819","nonce":26875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":26875},{"type":"v1","addr":"172.21.15.156:6823","nonce":26875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":26875},{"type":"v1","addr":"172.21.15.156:6821","nonce":26875}]},"public_addr":"172.21.15.156:6816/26875","cluster_addr":"172.21.15.156:6819/26875","heartbeat_back_addr":"172.21.15.156:6823/26875","heartbeat_front_addr":"172.21.15.156:6821/26875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.582513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.686413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:05:01.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb725aa0700 10 mgrc shutdown 2023-09-29T23:05:01.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb725aa0700 1 -- 172.21.15.115:0/334521927 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb70408e8e0 msgr2=0x7fb704090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb725aa0700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb70408e8e0 0x7fb704090d90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb720144790 tx=0x7fb70c009040 comp rx=0 tx=0).stop 2023-09-29T23:05:01.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb725aa0700 1 -- 172.21.15.115:0/334521927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7200670a0 msgr2=0x7fb7201436c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb725aa0700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7200670a0 0x7fb7201436c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb71400c580 tx=0x7fb714007e10 comp rx=0 tx=0).stop 2023-09-29T23:05:01.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb725aa0700 1 -- 172.21.15.115:0/334521927 shutdown_connections 2023-09-29T23:05:01.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb725aa0700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7200a4140 0x7fb72013b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb725aa0700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb720068130 0x7fb72006d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb725aa0700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb70408e8e0 0x7fb704090d90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb725aa0700 1 --2- 172.21.15.115:0/334521927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7200670a0 0x7fb7201436c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb725aa0700 1 -- 172.21.15.115:0/334521927 >> 172.21.15.115:0/334521927 conn(0x7fb7200b1d20 msgr2=0x7fb72009c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:01.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb725aa0700 1 -- 172.21.15.115:0/334521927 shutdown_connections 2023-09-29T23:05:01.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.345+0000 7fb725aa0700 1 -- 172.21.15.115:0/334521927 wait complete. 2023-09-29T23:05:01.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-29T23:04:54.900033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-29T23:04:58.342574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-29T23:05:01.361 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-29T23:05:01.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.469+0000 7fe41ab2c700 1 Processor -- start 2023-09-29T23:05:01.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.469+0000 7fe41ab2c700 1 -- start start 2023-09-29T23:05:01.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.469+0000 7fe41ab2c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe41406ae70 0x7fe41409cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.469+0000 7fe41ab2c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41409d310 con 0x7fe414140da0 2023-09-29T23:05:01.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.469+0000 7fe41ab2c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe414141c70 con 0x7fe414133a90 2023-09-29T23:05:01.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.469+0000 7fe41ab2c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41406b240 con 0x7fe41406ae70 2023-09-29T23:05:01.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.469+0000 7fe419329700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe414140da0 0x7fe414141560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42640/0 (socket says 172.21.15.115:42640) 2023-09-29T23:05:01.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.469+0000 7fe419329700 1 -- 172.21.15.115:0/548518299 learned_addr learned my addr 172.21.15.115:0/548518299 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:01.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.469+0000 7fe419b2a700 1 --2- 172.21.15.115:0/548518299 >> v2:172.21.15.156:3300/0 conn(0x7fe41406ae70 0x7fe41409cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575409947 0 0) 0x7fe410001110 con 0x7fe414140da0 2023-09-29T23:05:01.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe400003570 con 0x7fe414140da0 2023-09-29T23:05:01.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735276026 0 0) 0x7fe414141c70 con 0x7fe414133a90 2023-09-29T23:05:01.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe410001110 con 0x7fe414133a90 2023-09-29T23:05:01.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2384224161 0 0) 0x7fe400003570 con 0x7fe414140da0 2023-09-29T23:05:01.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 >> v2:172.21.15.156:3300/0 conn(0x7fe41406ae70 msgr2=0x7fe41409cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:01.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 --2- 172.21.15.115:0/548518299 >> v2:172.21.15.156:3300/0 conn(0x7fe41406ae70 0x7fe41409cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 >> v1:172.21.15.156:6789/0 conn(0x7fe414133a90 legacy=0x7fe4141480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4140a4090 con 0x7fe414140da0 2023-09-29T23:05:01.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3987234196 0 0) 0x7fe410001600 con 0x7fe414140da0 2023-09-29T23:05:01.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe419b2a700 1 --2- 172.21.15.115:0/548518299 >> v2:172.21.15.156:3300/0 conn(0x7fe41406ae70 0x7fe41409cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:01.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 >> v1:172.21.15.115:6789/0 conn(0x7fe414140da0 legacy=0x7fe414141560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 --2- 172.21.15.115:0/548518299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe400003bf0 0x7fe400003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 --2- 172.21.15.115:0/548518299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe400004810 0x7fe400004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 --2- 172.21.15.115:0/548518299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4000051c0 0x7fe40000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41406b240 con 0x7fe400003bf0 2023-09-29T23:05:01.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40000c0b0 con 0x7fe4000051c0 2023-09-29T23:05:01.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40000c270 con 0x7fe400004810 2023-09-29T23:05:01.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe419b2a700 1 --2- 172.21.15.115:0/548518299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe400003bf0 0x7fe400003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe419329700 1 --2- 172.21.15.115:0/548518299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe400004810 0x7fe400004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe41a32b700 1 --2- 172.21.15.115:0/548518299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4000051c0 0x7fe40000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe419329700 1 -- 172.21.15.115:0/548518299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4000051c0 msgr2=0x7fe40000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:01.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe419329700 1 --2- 172.21.15.115:0/548518299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4000051c0 0x7fe40000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe419329700 1 -- 172.21.15.115:0/548518299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe400003bf0 msgr2=0x7fe400003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:01.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe419329700 1 --2- 172.21.15.115:0/548518299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe400003bf0 0x7fe400003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe419329700 1 -- 172.21.15.115:0/548518299 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400003570 con 0x7fe400004810 2023-09-29T23:05:01.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe41a32b700 1 -- 172.21.15.115:0/548518299 reap_dead start 2023-09-29T23:05:01.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe419329700 1 --2- 172.21.15.115:0/548518299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe400004810 0x7fe400004c80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe41000c440 tx=0x7fe410007a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1c0f0ab3cf069a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:01.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000cd70 con 0x7fe400004810 2023-09-29T23:05:01.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe410005920 con 0x7fe400004810 2023-09-29T23:05:01.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe418b28700 1 -- 172.21.15.115:0/548518299 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410005ce0 con 0x7fe400004810 2023-09-29T23:05:01.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe41ab2c700 1 -- 172.21.15.115:0/548518299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe400004810 msgr2=0x7fe400004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe41ab2c700 1 --2- 172.21.15.115:0/548518299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe400004810 0x7fe400004c80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe41000c440 tx=0x7fe410007a00 comp rx=0 tx=0).stop 2023-09-29T23:05:01.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe41ab2c700 1 -- 172.21.15.115:0/548518299 shutdown_connections 2023-09-29T23:05:01.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe41ab2c700 1 --2- 172.21.15.115:0/548518299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe400004810 0x7fe400004c80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe41ab2c700 1 -- 172.21.15.115:0/548518299 >> 172.21.15.115:0/548518299 conn(0x7fe4140694c0 msgr2=0x7fe41406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:01.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe41ab2c700 1 -- 172.21.15.115:0/548518299 shutdown_connections 2023-09-29T23:05:01.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.473+0000 7fe41ab2c700 1 -- 172.21.15.115:0/548518299 wait complete. 2023-09-29T23:05:01.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe41ab2c700 1 Processor -- start 2023-09-29T23:05:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe41ab2c700 1 -- start start 2023-09-29T23:05:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe41ab2c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe400004810 0x7fe41413ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe41ab2c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4140afc30 0x7fe4140b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe41ab2c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe41409e830 0x7fe4140a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe41ab2c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140a2250 con 0x7fe400004810 2023-09-29T23:05:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe41ab2c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41409ec60 con 0x7fe41409e830 2023-09-29T23:05:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe41ab2c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41409eef0 con 0x7fe4140afc30 2023-09-29T23:05:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe419b2a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe400004810 0x7fe41413ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe419b2a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe400004810 0x7fe41413ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49126/0 (socket says 172.21.15.115:49126) 2023-09-29T23:05:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe419b2a700 1 -- 172.21.15.115:0/4085111198 learned_addr learned my addr 172.21.15.115:0/4085111198 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe41a32b700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe41409e830 0x7fe4140a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe419329700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4140afc30 0x7fe4140b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe419b2a700 1 -- 172.21.15.115:0/4085111198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4140afc30 msgr2=0x7fe4140b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe419b2a700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4140afc30 0x7fe4140b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe419b2a700 1 -- 172.21.15.115:0/4085111198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe41409e830 msgr2=0x7fe4140a12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe419b2a700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe41409e830 0x7fe4140a12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe419b2a700 1 -- 172.21.15.115:0/4085111198 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41409f190 con 0x7fe400004810 2023-09-29T23:05:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe419b2a700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe400004810 0x7fe41413ea10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe404011d70 tx=0x7fe4040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe409ffb700 1 -- 172.21.15.115:0/4085111198 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404011e70 con 0x7fe400004810 2023-09-29T23:05:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe409ffb700 1 -- 172.21.15.115:0/4085111198 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40400fc20 con 0x7fe400004810 2023-09-29T23:05:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe409ffb700 1 -- 172.21.15.115:0/4085111198 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404014440 con 0x7fe400004810 2023-09-29T23:05:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe41ab2c700 1 -- 172.21.15.115:0/4085111198 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe414094f10 con 0x7fe400004810 2023-09-29T23:05:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe41ab2c700 1 -- 172.21.15.115:0/4085111198 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4140a2b60 con 0x7fe400004810 2023-09-29T23:05:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.477+0000 7fe41ab2c700 1 -- 172.21.15.115:0/4085111198 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41404be00 con 0x7fe400004810 2023-09-29T23:05:01.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.481+0000 7fe409ffb700 1 -- 172.21.15.115:0/4085111198 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fe404027430 con 0x7fe400004810 2023-09-29T23:05:01.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.481+0000 7fe409ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:01.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.481+0000 7fe409ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:01.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.481+0000 7fe409ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:01.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.481+0000 7fe409ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:01.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.481+0000 7fe409ffb700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe3f808e8b0 0x7fe3f8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.481+0000 7fe409ffb700 1 -- 172.21.15.115:0/4085111198 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fe404018030 con 0x7fe400004810 2023-09-29T23:05:01.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.481+0000 7fe419329700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe3f808e8b0 0x7fe3f8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.481+0000 7fe419329700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe3f808e8b0 0x7fe3f8090d60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe410007e20 tx=0x7fe410015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:01.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.485+0000 7fe409ffb700 1 -- 172.21.15.115:0/4085111198 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe4040860a0 con 0x7fe400004810 2023-09-29T23:05:01.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 1 -- 172.21.15.115:0/4085111198 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4140a4350 con 0x7fe400004810 2023-09-29T23:05:01.650 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe409ffb700 1 -- 172.21.15.115:0/4085111198 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4040220a0 con 0x7fe400004810 2023-09-29T23:05:01.650 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2023-09-29T23:05:01.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 10 mgrc shutdown 2023-09-29T23:05:01.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 1 -- 172.21.15.115:0/4085111198 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe3f808e8b0 msgr2=0x7fe3f8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe3f808e8b0 0x7fe3f8090d60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe410007e20 tx=0x7fe410015000 comp rx=0 tx=0).stop 2023-09-29T23:05:01.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 1 -- 172.21.15.115:0/4085111198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe400004810 msgr2=0x7fe41413ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe400004810 0x7fe41413ea10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe404011d70 tx=0x7fe4040091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 1 -- 172.21.15.115:0/4085111198 shutdown_connections 2023-09-29T23:05:01.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe41409e830 0x7fe4140a12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4140afc30 0x7fe4140b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe3f808e8b0 0x7fe3f8090d60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 1 --2- 172.21.15.115:0/4085111198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe400004810 0x7fe41413ea10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 1 -- 172.21.15.115:0/4085111198 >> 172.21.15.115:0/4085111198 conn(0x7fe4140694c0 msgr2=0x7fe414062b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:01.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 1 -- 172.21.15.115:0/4085111198 shutdown_connections 2023-09-29T23:05:01.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.649+0000 7fe41ab2c700 1 -- 172.21.15.115:0/4085111198 wait complete. 2023-09-29T23:05:01.664 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-29T23:05:01.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea2d4b6700 1 Processor -- start 2023-09-29T23:05:01.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea2d4b6700 1 -- start start 2023-09-29T23:05:01.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea2d4b6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fea28068e30 0x7fea280a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea2d4b6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0030 0x7fea2813f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea2d4b6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fea280a0430 0x7fea2813f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea2d4b6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea2809fc00 con 0x7fea28068e30 2023-09-29T23:05:01.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea2d4b6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea28069200 con 0x7fea280a0430 2023-09-29T23:05:01.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea2d4b6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea280a1df0 con 0x7fea280a0030 2023-09-29T23:05:01.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea267fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0030 0x7fea2813f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea26ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fea28068e30 0x7fea280a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea267fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0030 0x7fea2813f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:38952/0 (socket says 172.21.15.115:38952) 2023-09-29T23:05:01.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea267fc700 1 -- 172.21.15.115:0/1856683396 learned_addr learned my addr 172.21.15.115:0/1856683396 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:01.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea277fe700 1 --2- 172.21.15.115:0/1856683396 >> v2:172.21.15.156:3300/0 conn(0x7fea280a0430 0x7fea2813f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea267fc700 1 -- 172.21.15.115:0/1856683396 >> v2:172.21.15.156:3300/0 conn(0x7fea280a0430 msgr2=0x7fea2813f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:01.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea267fc700 1 --2- 172.21.15.115:0/1856683396 >> v2:172.21.15.156:3300/0 conn(0x7fea280a0430 0x7fea2813f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea267fc700 1 -- 172.21.15.115:0/1856683396 >> v2:172.21.15.115:3300/0 conn(0x7fea28068e30 msgr2=0x7fea280a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:01.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea267fc700 1 --2- 172.21.15.115:0/1856683396 >> v2:172.21.15.115:3300/0 conn(0x7fea28068e30 0x7fea280a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea267fc700 1 -- 172.21.15.115:0/1856683396 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea280b6a60 con 0x7fea280a0030 2023-09-29T23:05:01.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea26ffd700 1 --2- 172.21.15.115:0/1856683396 >> v2:172.21.15.115:3300/0 conn(0x7fea28068e30 0x7fea280a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:01.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea267fc700 1 --2- 172.21.15.115:0/1856683396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0030 0x7fea2813f0b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fea280b5f00 tx=0x7fea18009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e1ced6221d676ed server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:01.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.773+0000 7fea25ffb700 1 -- 172.21.15.115:0/1856683396 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1800b640 con 0x7fea280a0030 2023-09-29T23:05:01.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.777+0000 7fea25ffb700 1 -- 172.21.15.115:0/1856683396 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1800b7a0 con 0x7fea280a0030 2023-09-29T23:05:01.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.777+0000 7fea25ffb700 1 -- 172.21.15.115:0/1856683396 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1800bb60 con 0x7fea280a0030 2023-09-29T23:05:01.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.777+0000 7fea2d4b6700 1 -- 172.21.15.115:0/1856683396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0030 msgr2=0x7fea2813f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.777+0000 7fea2d4b6700 1 --2- 172.21.15.115:0/1856683396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0030 0x7fea2813f0b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fea280b5f00 tx=0x7fea18009250 comp rx=0 tx=0).stop 2023-09-29T23:05:01.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.777+0000 7fea2d4b6700 1 -- 172.21.15.115:0/1856683396 shutdown_connections 2023-09-29T23:05:01.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.777+0000 7fea2d4b6700 1 --2- 172.21.15.115:0/1856683396 >> v2:172.21.15.156:3300/0 conn(0x7fea280a0430 0x7fea2813f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.777+0000 7fea2d4b6700 1 --2- 172.21.15.115:0/1856683396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0030 0x7fea2813f0b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.777+0000 7fea2d4b6700 1 --2- 172.21.15.115:0/1856683396 >> v2:172.21.15.115:3300/0 conn(0x7fea28068e30 0x7fea280a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.777+0000 7fea2d4b6700 1 -- 172.21.15.115:0/1856683396 >> 172.21.15.115:0/1856683396 conn(0x7fea28069670 msgr2=0x7fea280684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:01.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.777+0000 7fea2d4b6700 1 -- 172.21.15.115:0/1856683396 shutdown_connections 2023-09-29T23:05:01.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.777+0000 7fea2d4b6700 1 -- 172.21.15.115:0/1856683396 wait complete. 2023-09-29T23:05:01.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.777+0000 7fea2d4b6700 1 Processor -- start 2023-09-29T23:05:01.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.777+0000 7fea2d4b6700 1 -- start start 2023-09-29T23:05:01.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea2d4b6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea28068e30 0x7fea280ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea2d4b6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea280a0030 0x7fea280ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea2d4b6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0430 0x7fea28152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea2d4b6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea280ac290 con 0x7fea28068e30 2023-09-29T23:05:01.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea2d4b6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea280ac440 con 0x7fea280a0030 2023-09-29T23:05:01.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea2d4b6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea280abab0 con 0x7fea280a0430 2023-09-29T23:05:01.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea26ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea28068e30 0x7fea280ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea277fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0430 0x7fea28152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea277fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0430 0x7fea28152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:38962/0 (socket says 172.21.15.115:38962) 2023-09-29T23:05:01.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea277fe700 1 -- 172.21.15.115:0/675745754 learned_addr learned my addr 172.21.15.115:0/675745754 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:01.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea267fc700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea280a0030 0x7fea280ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea277fe700 1 -- 172.21.15.115:0/675745754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea280a0030 msgr2=0x7fea280ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea277fe700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea280a0030 0x7fea280ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea277fe700 1 -- 172.21.15.115:0/675745754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea28068e30 msgr2=0x7fea280ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea277fe700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea28068e30 0x7fea280ab140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea277fe700 1 -- 172.21.15.115:0/675745754 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea10009420 con 0x7fea280a0430 2023-09-29T23:05:01.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea267fc700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea280a0030 0x7fea280ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:01.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea26ffd700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea28068e30 0x7fea280ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:01.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea277fe700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0430 0x7fea28152d20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fea20009df0 tx=0x7fea2000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:01.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea1effd700 1 -- 172.21.15.115:0/675745754 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2000cb50 con 0x7fea280a0430 2023-09-29T23:05:01.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea1effd700 1 -- 172.21.15.115:0/675745754 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2000f040 con 0x7fea280a0430 2023-09-29T23:05:01.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea2d4b6700 1 -- 172.21.15.115:0/675745754 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea180094f0 con 0x7fea280a0430 2023-09-29T23:05:01.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea1effd700 1 -- 172.21.15.115:0/675745754 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20014480 con 0x7fea280a0430 2023-09-29T23:05:01.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea2d4b6700 1 -- 172.21.15.115:0/675745754 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea281536e0 con 0x7fea280a0430 2023-09-29T23:05:01.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.781+0000 7fea2d4b6700 1 -- 172.21.15.115:0/675745754 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea280ac5b0 con 0x7fea280a0430 2023-09-29T23:05:01.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.785+0000 7fea1effd700 1 -- 172.21.15.115:0/675745754 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fea20014830 con 0x7fea280a0430 2023-09-29T23:05:01.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.785+0000 7fea1effd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:01.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.785+0000 7fea1effd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:01.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.785+0000 7fea1effd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:01.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.785+0000 7fea1effd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:01.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.785+0000 7fea1effd700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fea0808e8b0 0x7fea08090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:01.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.785+0000 7fea1effd700 1 -- 172.21.15.115:0/675745754 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fea200b4d90 con 0x7fea280a0430 2023-09-29T23:05:01.789 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.785+0000 7fea26ffd700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fea0808e8b0 0x7fea08090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:01.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.789+0000 7fea26ffd700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fea0808e8b0 0x7fea08090d60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fea10011600 tx=0x7fea100091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:01.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.793+0000 7fea1effd700 1 -- 172.21.15.115:0/675745754 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fea20085b10 con 0x7fea280a0430 2023-09-29T23:05:01.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.953+0000 7fea2d4b6700 1 -- 172.21.15.115:0/675745754 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fea28070990 con 0x7fea280a0430 2023-09-29T23:05:01.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.953+0000 7fea1effd700 1 -- 172.21.15.115:0/675745754 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fea20018070 con 0x7fea280a0430 2023-09-29T23:05:01.956 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 8 2023-09-29T23:05:01.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.957+0000 7fea2d4b6700 10 mgrc shutdown 2023-09-29T23:05:01.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.957+0000 7fea2d4b6700 1 -- 172.21.15.115:0/675745754 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fea0808e8b0 msgr2=0x7fea08090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.957+0000 7fea2d4b6700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fea0808e8b0 0x7fea08090d60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fea10011600 tx=0x7fea100091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.957+0000 7fea2d4b6700 1 -- 172.21.15.115:0/675745754 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0430 msgr2=0x7fea28152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:01.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.957+0000 7fea2d4b6700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0430 0x7fea28152d20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fea20009df0 tx=0x7fea2000b040 comp rx=0 tx=0).stop 2023-09-29T23:05:01.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.957+0000 7fea2d4b6700 1 -- 172.21.15.115:0/675745754 shutdown_connections 2023-09-29T23:05:01.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.957+0000 7fea2d4b6700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea280a0430 0x7fea28152d20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.957+0000 7fea2d4b6700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea280a0030 0x7fea280ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.957+0000 7fea2d4b6700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fea0808e8b0 0x7fea08090d60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.957+0000 7fea2d4b6700 1 --2- 172.21.15.115:0/675745754 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea28068e30 0x7fea280ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:01.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.957+0000 7fea2d4b6700 1 -- 172.21.15.115:0/675745754 >> 172.21.15.115:0/675745754 conn(0x7fea28069670 msgr2=0x7fea280a7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:01.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.957+0000 7fea2d4b6700 1 -- 172.21.15.115:0/675745754 shutdown_connections 2023-09-29T23:05:01.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:01.957+0000 7fea2d4b6700 1 -- 172.21.15.115:0/675745754 wait complete. 2023-09-29T23:05:01.974 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-29T23:05:02.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.073+0000 7f1c06b98700 1 Processor -- start 2023-09-29T23:05:02.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.073+0000 7f1c06b98700 1 -- start start 2023-09-29T23:05:02.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.073+0000 7f1c06b98700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1c0009d470 0x7f1c0009c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.073+0000 7f1c06b98700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0013d150 con 0x7f1c0009dc30 2023-09-29T23:05:02.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.073+0000 7f1c06b98700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0006a940 con 0x7f1c00069c90 2023-09-29T23:05:02.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.073+0000 7f1c06b98700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0009ea40 con 0x7f1c0009d470 2023-09-29T23:05:02.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.073+0000 7f1c06397700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1c0009d470 0x7f1c0009c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.073+0000 7f1c05395700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1c0009dc30 0x7f1c0013ca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42652/0 (socket says 172.21.15.115:42652) 2023-09-29T23:05:02.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.073+0000 7f1c05395700 1 -- 172.21.15.115:0/3699234624 learned_addr learned my addr 172.21.15.115:0/3699234624 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:02.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.073+0000 7f1c06397700 1 -- 172.21.15.115:0/3699234624 >> v1:172.21.15.156:6789/0 conn(0x7f1c00069c90 legacy=0x7f1c0009e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.073+0000 7f1c06397700 1 -- 172.21.15.115:0/3699234624 >> v1:172.21.15.115:6789/0 conn(0x7f1c0009dc30 legacy=0x7f1c0013ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.073+0000 7f1c06397700 1 -- 172.21.15.115:0/3699234624 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0006a060 con 0x7f1c0009d470 2023-09-29T23:05:02.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06397700 1 --2- 172.21.15.115:0/3699234624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c0009d470 0x7f1c0009c3a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0098e0 tx=0x7f1bfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba31558d110c2ab server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:02.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c04b94700 1 -- 172.21.15.115:0/3699234624 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc009e20 con 0x7f1c0009d470 2023-09-29T23:05:02.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c04b94700 1 -- 172.21.15.115:0/3699234624 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc00b860 con 0x7f1c0009d470 2023-09-29T23:05:02.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c04b94700 1 -- 172.21.15.115:0/3699234624 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00bc00 con 0x7f1c0009d470 2023-09-29T23:05:02.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 -- 172.21.15.115:0/3699234624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c0009d470 msgr2=0x7f1c0009c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 --2- 172.21.15.115:0/3699234624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c0009d470 0x7f1c0009c3a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0098e0 tx=0x7f1bfc0091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 -- 172.21.15.115:0/3699234624 shutdown_connections 2023-09-29T23:05:02.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 --2- 172.21.15.115:0/3699234624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c0009d470 0x7f1c0009c3a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 -- 172.21.15.115:0/3699234624 >> 172.21.15.115:0/3699234624 conn(0x7f1c000a2a60 msgr2=0x7f1c000a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:02.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 -- 172.21.15.115:0/3699234624 shutdown_connections 2023-09-29T23:05:02.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 -- 172.21.15.115:0/3699234624 wait complete. 2023-09-29T23:05:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 Processor -- start 2023-09-29T23:05:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 -- start start 2023-09-29T23:05:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c00069c90 0x7f1c000b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c0009d470 0x7f1c0014b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c0009dc30 0x7f1c0014b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000b1610 con 0x7f1c0009d470 2023-09-29T23:05:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000b1440 con 0x7f1c00069c90 2023-09-29T23:05:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06b98700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0014bdd0 con 0x7f1c0009dc30 2023-09-29T23:05:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c05395700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c0009d470 0x7f1c0014b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.082 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c06397700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c0009dc30 0x7f1c0014b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c05395700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c0009d470 0x7f1c0014b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49148/0 (socket says 172.21.15.115:49148) 2023-09-29T23:05:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.077+0000 7f1c05395700 1 -- 172.21.15.115:0/4092645649 learned_addr learned my addr 172.21.15.115:0/4092645649 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1c05b96700 1 --2- 172.21.15.115:0/4092645649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c00069c90 0x7f1c000b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1c05395700 1 -- 172.21.15.115:0/4092645649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c0009dc30 msgr2=0x7f1c0014b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1c05395700 1 --2- 172.21.15.115:0/4092645649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c0009dc30 0x7f1c0014b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1c05395700 1 -- 172.21.15.115:0/4092645649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c00069c90 msgr2=0x7f1c000b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1c05395700 1 --2- 172.21.15.115:0/4092645649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c00069c90 0x7f1c000b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1c05395700 1 -- 172.21.15.115:0/4092645649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc009420 con 0x7f1c0009d470 2023-09-29T23:05:02.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1c05395700 1 --2- 172.21.15.115:0/4092645649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c0009d470 0x7f1c0014b140 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000c590 tx=0x7f1bf0001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:02.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1bf5ffb700 1 -- 172.21.15.115:0/4092645649 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0005b30 con 0x7f1c0009d470 2023-09-29T23:05:02.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1bf5ffb700 1 -- 172.21.15.115:0/4092645649 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf0005cb0 con 0x7f1c0009d470 2023-09-29T23:05:02.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1c06b98700 1 -- 172.21.15.115:0/4092645649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c000b1cc0 con 0x7f1c0009d470 2023-09-29T23:05:02.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1bf5ffb700 1 -- 172.21.15.115:0/4092645649 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0007320 con 0x7f1c0009d470 2023-09-29T23:05:02.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1c06b98700 1 -- 172.21.15.115:0/4092645649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0006d210 con 0x7f1c0009d470 2023-09-29T23:05:02.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1c06b98700 1 -- 172.21.15.115:0/4092645649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0004be00 con 0x7f1c0009d470 2023-09-29T23:05:02.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.081+0000 7f1bf5ffb700 1 -- 172.21.15.115:0/4092645649 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f1bf001b3b0 con 0x7f1c0009d470 2023-09-29T23:05:02.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.085+0000 7f1bf5ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:02.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.085+0000 7f1bf5ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:02.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.085+0000 7f1bf5ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:02.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.085+0000 7f1bf5ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:02.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.085+0000 7f1bf5ffb700 1 --2- 172.21.15.115:0/4092645649 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1be408e8b0 0x7f1be4090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.085+0000 7f1bf5ffb700 1 -- 172.21.15.115:0/4092645649 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f1bf00b3850 con 0x7f1c0009d470 2023-09-29T23:05:02.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.085+0000 7f1c05b96700 1 --2- 172.21.15.115:0/4092645649 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1be408e8b0 0x7f1be4090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.085+0000 7f1c05b96700 1 --2- 172.21.15.115:0/4092645649 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1be408e8b0 0x7f1be4090d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8007fd0 tx=0x7f1bf80016f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:02.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.089+0000 7f1bf5ffb700 1 -- 172.21.15.115:0/4092645649 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1bf00845d0 con 0x7f1c0009d470 2023-09-29T23:05:02.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 1 -- 172.21.15.115:0/4092645649 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1c0013da00 con 0x7f1c0009d470 2023-09-29T23:05:02.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1bf5ffb700 1 -- 172.21.15.115:0/4092645649 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7f1bf0017030 con 0x7f1c0009d470 2023-09-29T23:05:02.254 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:02.254 INFO:teuthology.orchestra.run.smithi115.stdout:[ 2023-09-29T23:05:02.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-09-29T23:05:02.254 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 1, 2023-09-29T23:05:02.255 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": ".mgr" 2023-09-29T23:05:02.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2023-09-29T23:05:02.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2023-09-29T23:05:02.255 INFO:teuthology.orchestra.run.smithi115.stdout: "poolnum": 2, 2023-09-29T23:05:02.255 INFO:teuthology.orchestra.run.smithi115.stdout: "poolname": "rbd" 2023-09-29T23:05:02.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2023-09-29T23:05:02.255 INFO:teuthology.orchestra.run.smithi115.stdout:] 2023-09-29T23:05:02.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 10 mgrc shutdown 2023-09-29T23:05:02.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 1 -- 172.21.15.115:0/4092645649 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1be408e8b0 msgr2=0x7f1be4090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 1 --2- 172.21.15.115:0/4092645649 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1be408e8b0 0x7f1be4090d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8007fd0 tx=0x7f1bf80016f0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 1 -- 172.21.15.115:0/4092645649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c0009d470 msgr2=0x7f1c0014b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 1 --2- 172.21.15.115:0/4092645649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c0009d470 0x7f1c0014b140 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000c590 tx=0x7f1bf0001020 comp rx=0 tx=0).stop 2023-09-29T23:05:02.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 1 -- 172.21.15.115:0/4092645649 shutdown_connections 2023-09-29T23:05:02.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 1 --2- 172.21.15.115:0/4092645649 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c0009dc30 0x7f1c0014b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 1 --2- 172.21.15.115:0/4092645649 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1be408e8b0 0x7f1be4090d60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 1 --2- 172.21.15.115:0/4092645649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c0009d470 0x7f1c0014b140 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 1 --2- 172.21.15.115:0/4092645649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c00069c90 0x7f1c000b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 1 -- 172.21.15.115:0/4092645649 >> 172.21.15.115:0/4092645649 conn(0x7f1c000a2a60 msgr2=0x7f1c0013c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:02.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 1 -- 172.21.15.115:0/4092645649 shutdown_connections 2023-09-29T23:05:02.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.253+0000 7f1c06b98700 1 -- 172.21.15.115:0/4092645649 wait complete. 2023-09-29T23:05:02.268 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-29T23:05:02.268 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-29T23:05:02.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.377+0000 7fe670dcb700 1 Processor -- start 2023-09-29T23:05:02.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.377+0000 7fe670dcb700 1 -- start start 2023-09-29T23:05:02.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe66c0b6a80 0x7fe66c0a1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe66c09f990 0x7fe66c0a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe66c13ff60 0x7fe66c1403c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66c0a1cb0 con 0x7fe66c09f990 2023-09-29T23:05:02.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66c0b6e50 con 0x7fe66c0b6a80 2023-09-29T23:05:02.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c0a88b0 con 0x7fe66c13ff60 2023-09-29T23:05:02.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe662ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe66c09f990 0x7fe66c0a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe662ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe66c09f990 0x7fe66c0a8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49162/0 (socket says 172.21.15.115:49162) 2023-09-29T23:05:02.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe662ffd700 1 -- 172.21.15.115:0/1262018265 learned_addr learned my addr 172.21.15.115:0/1262018265 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:02.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe66bfff700 1 --2- 172.21.15.115:0/1262018265 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe66c13ff60 0x7fe66c1403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe66b7fe700 1 --2- 172.21.15.115:0/1262018265 >> v2:172.21.15.156:3300/0 conn(0x7fe66c0b6a80 0x7fe66c0a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe662ffd700 1 -- 172.21.15.115:0/1262018265 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe66c13ff60 msgr2=0x7fe66c1403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:02.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe662ffd700 1 --2- 172.21.15.115:0/1262018265 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe66c13ff60 0x7fe66c1403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe662ffd700 1 -- 172.21.15.115:0/1262018265 >> v2:172.21.15.156:3300/0 conn(0x7fe66c0b6a80 msgr2=0x7fe66c0a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:02.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe662ffd700 1 --2- 172.21.15.115:0/1262018265 >> v2:172.21.15.156:3300/0 conn(0x7fe66c0b6a80 0x7fe66c0a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe662ffd700 1 -- 172.21.15.115:0/1262018265 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c09fe80 con 0x7fe66c09f990 2023-09-29T23:05:02.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe66bfff700 1 --2- 172.21.15.115:0/1262018265 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe66c13ff60 0x7fe66c1403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:02.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe662ffd700 1 --2- 172.21.15.115:0/1262018265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe66c09f990 0x7fe66c0a8370 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe6540099b0 tx=0x7fe654009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63af49a9835eb5fe server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:02.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe66affd700 1 -- 172.21.15.115:0/1262018265 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65400b820 con 0x7fe66c09f990 2023-09-29T23:05:02.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe66affd700 1 -- 172.21.15.115:0/1262018265 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65400b980 con 0x7fe66c09f990 2023-09-29T23:05:02.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe66affd700 1 -- 172.21.15.115:0/1262018265 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65400bd20 con 0x7fe66c09f990 2023-09-29T23:05:02.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 -- 172.21.15.115:0/1262018265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe66c09f990 msgr2=0x7fe66c0a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 --2- 172.21.15.115:0/1262018265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe66c09f990 0x7fe66c0a8370 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe6540099b0 tx=0x7fe654009250 comp rx=0 tx=0).stop 2023-09-29T23:05:02.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 -- 172.21.15.115:0/1262018265 shutdown_connections 2023-09-29T23:05:02.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 --2- 172.21.15.115:0/1262018265 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe66c13ff60 0x7fe66c1403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 --2- 172.21.15.115:0/1262018265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe66c09f990 0x7fe66c0a8370 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 --2- 172.21.15.115:0/1262018265 >> v2:172.21.15.156:3300/0 conn(0x7fe66c0b6a80 0x7fe66c0a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 -- 172.21.15.115:0/1262018265 >> 172.21.15.115:0/1262018265 conn(0x7fe66c0a8be0 msgr2=0x7fe66c0b6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:02.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 -- 172.21.15.115:0/1262018265 shutdown_connections 2023-09-29T23:05:02.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.381+0000 7fe670dcb700 1 -- 172.21.15.115:0/1262018265 wait complete. 2023-09-29T23:05:02.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe670dcb700 1 Processor -- start 2023-09-29T23:05:02.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe670dcb700 1 -- start start 2023-09-29T23:05:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe670dcb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe66c0b6a80 0x7fe66c0a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe670dcb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe66c13ff60 0x7fe66c152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe670dcb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe66c0b3950 0x7fe66c13c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe670dcb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c0aa780 con 0x7fe66c0b3950 2023-09-29T23:05:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe670dcb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c0ab440 con 0x7fe66c13ff60 2023-09-29T23:05:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe670dcb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c0ab920 con 0x7fe66c0b6a80 2023-09-29T23:05:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe66b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe66c0b6a80 0x7fe66c0a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe66b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe66c0b6a80 0x7fe66c0a9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:38982/0 (socket says 172.21.15.115:38982) 2023-09-29T23:05:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe66b7fe700 1 -- 172.21.15.115:0/319991312 learned_addr learned my addr 172.21.15.115:0/319991312 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe66bfff700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe66c0b3950 0x7fe66c13c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe662ffd700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe66c13ff60 0x7fe66c152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe66bfff700 1 -- 172.21.15.115:0/319991312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe66c0b6a80 msgr2=0x7fe66c0a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe66bfff700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe66c0b6a80 0x7fe66c0a9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe66bfff700 1 -- 172.21.15.115:0/319991312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe66c13ff60 msgr2=0x7fe66c152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe66bfff700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe66c13ff60 0x7fe66c152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe66bfff700 1 -- 172.21.15.115:0/319991312 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6540094f0 con 0x7fe66c0b3950 2023-09-29T23:05:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe66b7fe700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe66c0b6a80 0x7fe66c0a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe66bfff700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe66c0b3950 0x7fe66c13c8a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe664007f60 tx=0x7fe6640098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:02.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe663fff700 1 -- 172.21.15.115:0/319991312 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66400db80 con 0x7fe66c0b3950 2023-09-29T23:05:02.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe663fff700 1 -- 172.21.15.115:0/319991312 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66400f040 con 0x7fe66c0b3950 2023-09-29T23:05:02.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe670dcb700 1 -- 172.21.15.115:0/319991312 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66c1535f0 con 0x7fe66c0b3950 2023-09-29T23:05:02.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe663fff700 1 -- 172.21.15.115:0/319991312 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664015440 con 0x7fe66c0b3950 2023-09-29T23:05:02.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.385+0000 7fe670dcb700 1 -- 172.21.15.115:0/319991312 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66c0a4130 con 0x7fe66c0b3950 2023-09-29T23:05:02.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.389+0000 7fe670dcb700 1 -- 172.21.15.115:0/319991312 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66c0b46a0 con 0x7fe66c0b3950 2023-09-29T23:05:02.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.393+0000 7fe663fff700 1 -- 172.21.15.115:0/319991312 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fe66401e3b0 con 0x7fe66c0b3950 2023-09-29T23:05:02.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.393+0000 7fe663fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:02.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.393+0000 7fe663fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:02.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.393+0000 7fe663fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:02.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.393+0000 7fe663fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:02.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.393+0000 7fe663fff700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe65008e8e0 0x7fe650090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.393+0000 7fe663fff700 1 -- 172.21.15.115:0/319991312 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fe6640b4a70 con 0x7fe66c0b3950 2023-09-29T23:05:02.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.393+0000 7fe66b7fe700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe65008e8e0 0x7fe650090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.393+0000 7fe66b7fe700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe65008e8e0 0x7fe650090d90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe65c006fd0 tx=0x7fe65c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:02.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.397+0000 7fe663fff700 1 -- 172.21.15.115:0/319991312 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe6640857f0 con 0x7fe66c0b3950 2023-09-29T23:05:02.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.553+0000 7fe670dcb700 1 -- 172.21.15.115:0/319991312 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe66c0a2210 con 0x7fe66c0b3950 2023-09-29T23:05:02.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.825+0000 7fe663fff700 1 -- 172.21.15.115:0/319991312 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe66c0a2210 con 0x7fe66c0b3950 2023-09-29T23:05:02.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.829+0000 7fe670dcb700 10 mgrc shutdown 2023-09-29T23:05:02.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.829+0000 7fe670dcb700 1 -- 172.21.15.115:0/319991312 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe65008e8e0 msgr2=0x7fe650090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.829+0000 7fe670dcb700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe65008e8e0 0x7fe650090d90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe65c006fd0 tx=0x7fe65c008040 comp rx=0 tx=0).stop 2023-09-29T23:05:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.829+0000 7fe670dcb700 1 -- 172.21.15.115:0/319991312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe66c0b3950 msgr2=0x7fe66c13c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.829+0000 7fe670dcb700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe66c0b3950 0x7fe66c13c8a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe664007f60 tx=0x7fe6640098f0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.829+0000 7fe670dcb700 1 -- 172.21.15.115:0/319991312 shutdown_connections 2023-09-29T23:05:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.829+0000 7fe670dcb700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe65008e8e0 0x7fe650090d90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.829+0000 7fe670dcb700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe66c0b3950 0x7fe66c13c8a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.829+0000 7fe670dcb700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe66c13ff60 0x7fe66c152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.829+0000 7fe670dcb700 1 --2- 172.21.15.115:0/319991312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe66c0b6a80 0x7fe66c0a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.829+0000 7fe670dcb700 1 -- 172.21.15.115:0/319991312 >> 172.21.15.115:0/319991312 conn(0x7fe66c0a8be0 msgr2=0x7fe66c0b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.829+0000 7fe670dcb700 1 -- 172.21.15.115:0/319991312 shutdown_connections 2023-09-29T23:05:02.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.829+0000 7fe670dcb700 1 -- 172.21.15.115:0/319991312 wait complete. 2023-09-29T23:05:02.834 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_metadata' created 2023-09-29T23:05:02.844 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-29T23:05:02.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.961+0000 7f0d74ebe700 1 Processor -- start 2023-09-29T23:05:02.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.961+0000 7f0d74ebe700 1 -- start start 2023-09-29T23:05:02.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.961+0000 7f0d74ebe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0d70140560 0x7f0d7009faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.961+0000 7f0d74ebe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d700a8300 0x7f0d70068410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.961+0000 7f0d74ebe700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d700a02f0 con 0x7f0d700a1290 2023-09-29T23:05:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.961+0000 7f0d74ebe700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d700a0030 con 0x7f0d70140560 2023-09-29T23:05:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.961+0000 7f0d74ebe700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d700a05b0 con 0x7f0d700a8300 2023-09-29T23:05:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.961+0000 7f0d6f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0d70140560 0x7f0d7009faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.961+0000 7f0d6f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0d70140560 0x7f0d7009faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49178/0 (socket says 172.21.15.115:49178) 2023-09-29T23:05:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.961+0000 7f0d6f7fe700 1 -- 172.21.15.115:0/1311727943 learned_addr learned my addr 172.21.15.115:0/1311727943 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.961+0000 7f0d6effd700 1 --2- 172.21.15.115:0/1311727943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d700a8300 0x7f0d70068410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d6f7fe700 1 -- 172.21.15.115:0/1311727943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d700a8300 msgr2=0x7f0d70068410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d6f7fe700 1 --2- 172.21.15.115:0/1311727943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d700a8300 0x7f0d70068410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d6f7fe700 1 -- 172.21.15.115:0/1311727943 >> v1:172.21.15.156:6789/0 conn(0x7f0d700a1290 legacy=0x7f0d70142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d6f7fe700 1 -- 172.21.15.115:0/1311727943 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d70068950 con 0x7f0d70140560 2023-09-29T23:05:02.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d6f7fe700 1 --2- 172.21.15.115:0/1311727943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d70140560 0x7f0d7009faf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009f50 tx=0x7f0d60009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38afb4414c085ce1 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:02.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d6e7fc700 1 -- 172.21.15.115:0/1311727943 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000e070 con 0x7f0d70140560 2023-09-29T23:05:02.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d6e7fc700 1 -- 172.21.15.115:0/1311727943 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6000b9c0 con 0x7f0d70140560 2023-09-29T23:05:02.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d6e7fc700 1 -- 172.21.15.115:0/1311727943 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600092e0 con 0x7f0d70140560 2023-09-29T23:05:02.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 -- 172.21.15.115:0/1311727943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d70140560 msgr2=0x7f0d7009faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 --2- 172.21.15.115:0/1311727943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d70140560 0x7f0d7009faf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009f50 tx=0x7f0d60009840 comp rx=0 tx=0).stop 2023-09-29T23:05:02.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 -- 172.21.15.115:0/1311727943 shutdown_connections 2023-09-29T23:05:02.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 --2- 172.21.15.115:0/1311727943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d700a8300 0x7f0d70068410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 --2- 172.21.15.115:0/1311727943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d70140560 0x7f0d7009faf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 -- 172.21.15.115:0/1311727943 >> 172.21.15.115:0/1311727943 conn(0x7f0d7006f060 msgr2=0x7f0d700670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:02.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 -- 172.21.15.115:0/1311727943 shutdown_connections 2023-09-29T23:05:02.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 -- 172.21.15.115:0/1311727943 wait complete. 2023-09-29T23:05:02.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 Processor -- start 2023-09-29T23:05:02.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 -- start start 2023-09-29T23:05:02.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d700a1290 0x7f0d700aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d700a8300 0x7f0d700ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d70140560 0x7f0d700abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d700a9fa0 con 0x7f0d70140560 2023-09-29T23:05:02.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d700ac180 con 0x7f0d700a1290 2023-09-29T23:05:02.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.965+0000 7f0d74ebe700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7014fcc0 con 0x7f0d700a8300 2023-09-29T23:05:02.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d6effd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d700a8300 0x7f0d700ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d6ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d70140560 0x7f0d700abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d6ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d70140560 0x7f0d700abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49182/0 (socket says 172.21.15.115:49182) 2023-09-29T23:05:02.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d6effd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d700a8300 0x7f0d700ab700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:39002/0 (socket says 172.21.15.115:39002) 2023-09-29T23:05:02.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d6ffff700 1 -- 172.21.15.115:0/399015724 learned_addr learned my addr 172.21.15.115:0/399015724 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:02.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d6f7fe700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d700a1290 0x7f0d700aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d6ffff700 1 -- 172.21.15.115:0/399015724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d700a8300 msgr2=0x7f0d700ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d6ffff700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d700a8300 0x7f0d700ab700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d6ffff700 1 -- 172.21.15.115:0/399015724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d700a1290 msgr2=0x7f0d700aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:02.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d6ffff700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d700a1290 0x7f0d700aa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:02.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d6ffff700 1 -- 172.21.15.115:0/399015724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d60009ae0 con 0x7f0d70140560 2023-09-29T23:05:02.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d6effd700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d700a8300 0x7f0d700ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:02.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d6ffff700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d70140560 0x7f0d700abc40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c590 tx=0x7f0d68007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:02.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d677fe700 1 -- 172.21.15.115:0/399015724 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68011590 con 0x7f0d70140560 2023-09-29T23:05:02.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d677fe700 1 -- 172.21.15.115:0/399015724 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d680116f0 con 0x7f0d70140560 2023-09-29T23:05:02.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d74ebe700 1 -- 172.21.15.115:0/399015724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d700a5860 con 0x7f0d70140560 2023-09-29T23:05:02.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d677fe700 1 -- 172.21.15.115:0/399015724 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68011ab0 con 0x7f0d70140560 2023-09-29T23:05:02.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d74ebe700 1 -- 172.21.15.115:0/399015724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7014f810 con 0x7f0d70140560 2023-09-29T23:05:02.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.969+0000 7f0d74ebe700 1 -- 172.21.15.115:0/399015724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7014fa90 con 0x7f0d70140560 2023-09-29T23:05:02.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.977+0000 7f0d677fe700 1 -- 172.21.15.115:0/399015724 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f0d6801b3b0 con 0x7f0d70140560 2023-09-29T23:05:02.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.977+0000 7f0d677fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:02.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.977+0000 7f0d677fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:02.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.977+0000 7f0d677fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:02.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.977+0000 7f0d677fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:02.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.977+0000 7f0d677fe700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f0d5008e8b0 0x7f0d50090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:02.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.977+0000 7f0d677fe700 1 -- 172.21.15.115:0/399015724 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3848+0+0 (secure 0 0 0) 0x7f0d680b3ee0 con 0x7f0d70140560 2023-09-29T23:05:02.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.977+0000 7f0d6f7fe700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f0d5008e8b0 0x7f0d50090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:02.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.977+0000 7f0d6f7fe700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f0d5008e8b0 0x7f0d50090d60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000c010 tx=0x7f0d60018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:02.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:02.981+0000 7f0d677fe700 1 -- 172.21.15.115:0/399015724 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0d68084af0 con 0x7f0d70140560 2023-09-29T23:05:03.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.141+0000 7f0d74ebe700 1 -- 172.21.15.115:0/399015724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0d7004be00 con 0x7f0d70140560 2023-09-29T23:05:03.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.841+0000 7f0d677fe700 1 -- 172.21.15.115:0/399015724 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0d68017020 con 0x7f0d70140560 2023-09-29T23:05:03.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.849+0000 7f0d74ebe700 10 mgrc shutdown 2023-09-29T23:05:03.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.849+0000 7f0d74ebe700 1 -- 172.21.15.115:0/399015724 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f0d5008e8b0 msgr2=0x7f0d50090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:03.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.849+0000 7f0d74ebe700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f0d5008e8b0 0x7f0d50090d60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000c010 tx=0x7f0d60018000 comp rx=0 tx=0).stop 2023-09-29T23:05:03.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.849+0000 7f0d74ebe700 1 -- 172.21.15.115:0/399015724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d70140560 msgr2=0x7f0d700abc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:03.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.849+0000 7f0d74ebe700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d70140560 0x7f0d700abc40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c590 tx=0x7f0d68007ec0 comp rx=0 tx=0).stop 2023-09-29T23:05:03.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.849+0000 7f0d74ebe700 1 -- 172.21.15.115:0/399015724 shutdown_connections 2023-09-29T23:05:03.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.849+0000 7f0d74ebe700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f0d5008e8b0 0x7f0d50090d60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:03.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.849+0000 7f0d74ebe700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d70140560 0x7f0d700abc40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:03.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.849+0000 7f0d74ebe700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d700a8300 0x7f0d700ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:03.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.849+0000 7f0d74ebe700 1 --2- 172.21.15.115:0/399015724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d700a1290 0x7f0d700aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:03.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.849+0000 7f0d74ebe700 1 -- 172.21.15.115:0/399015724 >> 172.21.15.115:0/399015724 conn(0x7f0d7006f060 msgr2=0x7f0d700a6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:03.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.849+0000 7f0d74ebe700 1 -- 172.21.15.115:0/399015724 shutdown_connections 2023-09-29T23:05:03.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.849+0000 7f0d74ebe700 1 -- 172.21.15.115:0/399015724 wait complete. 2023-09-29T23:05:03.853 INFO:teuthology.orchestra.run.smithi115.stderr:pool 'cephfs_data' created 2023-09-29T23:05:03.866 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-29T23:05:03.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.961+0000 7f766ffff700 1 Processor -- start 2023-09-29T23:05:03.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.961+0000 7f766ffff700 1 -- start start 2023-09-29T23:05:03.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.961+0000 7f766ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76700a1a60 0x7f767014b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:03.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.961+0000 7f766ffff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76700690b0 con 0x7f7670068ce0 2023-09-29T23:05:03.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.961+0000 7f766ffff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76700b68a0 con 0x7f76700a1690 2023-09-29T23:05:03.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.961+0000 7f766ffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76700b6b60 con 0x7f76700a1a60 2023-09-29T23:05:03.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.961+0000 7f766f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76700a1a60 0x7f767014b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:03.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.961+0000 7f766f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76700a1a60 0x7f767014b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:39018/0 (socket says 172.21.15.115:39018) 2023-09-29T23:05:03.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.961+0000 7f766f7fe700 1 -- 172.21.15.115:0/796796203 learned_addr learned my addr 172.21.15.115:0/796796203 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:03.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.961+0000 7f766effd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f7670068ce0 0x7f767009fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42664/0 (socket says 172.21.15.115:42664) 2023-09-29T23:05:03.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.961+0000 7f766f7fe700 1 -- 172.21.15.115:0/796796203 >> v1:172.21.15.156:6789/0 conn(0x7f76700a1690 legacy=0x7f767013ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:03.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.961+0000 7f766f7fe700 1 -- 172.21.15.115:0/796796203 >> v1:172.21.15.115:6789/0 conn(0x7f7670068ce0 legacy=0x7f767009fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:03.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.961+0000 7f766f7fe700 1 -- 172.21.15.115:0/796796203 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767013f680 con 0x7f76700a1a60 2023-09-29T23:05:03.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766f7fe700 1 --2- 172.21.15.115:0/796796203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76700a1a60 0x7f767014b290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7668009f50 tx=0x7f7668009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4f935c1f68f2a9d server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:03.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766dffb700 1 -- 172.21.15.115:0/796796203 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766800e070 con 0x7f76700a1a60 2023-09-29T23:05:03.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766dffb700 1 -- 172.21.15.115:0/796796203 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766800bb00 con 0x7f76700a1a60 2023-09-29T23:05:03.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766dffb700 1 -- 172.21.15.115:0/796796203 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76680092e0 con 0x7f76700a1a60 2023-09-29T23:05:03.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 -- 172.21.15.115:0/796796203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76700a1a60 msgr2=0x7f767014b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:03.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 --2- 172.21.15.115:0/796796203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76700a1a60 0x7f767014b290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7668009f50 tx=0x7f7668009840 comp rx=0 tx=0).stop 2023-09-29T23:05:03.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 -- 172.21.15.115:0/796796203 shutdown_connections 2023-09-29T23:05:03.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 --2- 172.21.15.115:0/796796203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76700a1a60 0x7f767014b290 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:03.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 -- 172.21.15.115:0/796796203 >> 172.21.15.115:0/796796203 conn(0x7f7670069520 msgr2=0x7f76700683a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:03.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 -- 172.21.15.115:0/796796203 shutdown_connections 2023-09-29T23:05:03.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 -- 172.21.15.115:0/796796203 wait complete. 2023-09-29T23:05:03.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 Processor -- start 2023-09-29T23:05:03.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 -- start start 2023-09-29T23:05:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7670068ce0 0x7f767013b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76700a1690 0x7f76700ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76700a1a60 0x7f767014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7670141f60 con 0x7f7670068ce0 2023-09-29T23:05:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76700abea0 con 0x7f76700a1a60 2023-09-29T23:05:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766ffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76700acdb0 con 0x7f76700a1690 2023-09-29T23:05:03.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7670068ce0 0x7f767013b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766e7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76700a1690 0x7f76700ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7670068ce0 0x7f767013b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49190/0 (socket says 172.21.15.115:49190) 2023-09-29T23:05:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.965+0000 7f766effd700 1 -- 172.21.15.115:0/1913721908 learned_addr learned my addr 172.21.15.115:0/1913721908 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f766f7fe700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76700a1a60 0x7f767014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f766e7fc700 1 -- 172.21.15.115:0/1913721908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76700a1a60 msgr2=0x7f767014fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f766e7fc700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76700a1a60 0x7f767014fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f766e7fc700 1 -- 172.21.15.115:0/1913721908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7670068ce0 msgr2=0x7f767013b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f766e7fc700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7670068ce0 0x7f767013b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f766e7fc700 1 -- 172.21.15.115:0/1913721908 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7668009ae0 con 0x7f76700a1690 2023-09-29T23:05:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f766f7fe700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76700a1a60 0x7f767014fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:03.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f766e7fc700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76700a1690 0x7f76700ac870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f766000c510 tx=0x7f7660007ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:03.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f7656ffd700 1 -- 172.21.15.115:0/1913721908 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660011590 con 0x7f76700a1690 2023-09-29T23:05:03.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f7656ffd700 1 -- 172.21.15.115:0/1913721908 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7660011710 con 0x7f76700a1690 2023-09-29T23:05:03.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f766ffff700 1 -- 172.21.15.115:0/1913721908 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7670150720 con 0x7f76700a1690 2023-09-29T23:05:03.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f7656ffd700 1 -- 172.21.15.115:0/1913721908 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660011ad0 con 0x7f76700a1690 2023-09-29T23:05:03.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f766ffff700 1 -- 172.21.15.115:0/1913721908 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767014ffd0 con 0x7f76700a1690 2023-09-29T23:05:03.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.969+0000 7f766ffff700 1 -- 172.21.15.115:0/1913721908 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767004be00 con 0x7f76700a1690 2023-09-29T23:05:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.973+0000 7f7656ffd700 1 -- 172.21.15.115:0/1913721908 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f766001c460 con 0x7f76700a1690 2023-09-29T23:05:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.973+0000 7f7656ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.973+0000 7f7656ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.973+0000 7f7656ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.973+0000 7f7656ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.973+0000 7f7656ffd700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f765c08e8b0 0x7f765c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:03.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.973+0000 7f7656ffd700 1 -- 172.21.15.115:0/1913721908 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f76600b4380 con 0x7f76700a1690 2023-09-29T23:05:03.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.973+0000 7f766effd700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f765c08e8b0 0x7f765c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:03.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.973+0000 7f766effd700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f765c08e8b0 0x7f765c090d60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7664004fd0 tx=0x7f7664007f70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:03.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:03.985+0000 7f7656ffd700 1 -- 172.21.15.115:0/1913721908 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7660084ea0 con 0x7f76700a1690 2023-09-29T23:05:04.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.181+0000 7f766ffff700 1 -- 172.21.15.115:0/1913721908 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f76700a7e20 con 0x7f76700a1690 2023-09-29T23:05:04.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.193+0000 7f7656ffd700 1 -- 172.21.15.115:0/1913721908 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f76600884c0 con 0x7f76700a1690 2023-09-29T23:05:04.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.197+0000 7f766ffff700 10 mgrc shutdown 2023-09-29T23:05:04.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.197+0000 7f766ffff700 1 -- 172.21.15.115:0/1913721908 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f765c08e8b0 msgr2=0x7f765c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.197+0000 7f766ffff700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f765c08e8b0 0x7f765c090d60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7664004fd0 tx=0x7f7664007f70 comp rx=0 tx=0).stop 2023-09-29T23:05:04.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.197+0000 7f766ffff700 1 -- 172.21.15.115:0/1913721908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76700a1690 msgr2=0x7f76700ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.197+0000 7f766ffff700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76700a1690 0x7f76700ac870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f766000c510 tx=0x7f7660007ea0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.197+0000 7f766ffff700 1 -- 172.21.15.115:0/1913721908 shutdown_connections 2023-09-29T23:05:04.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.197+0000 7f766ffff700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76700a1a60 0x7f767014fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.197+0000 7f766ffff700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76700a1690 0x7f76700ac870 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.197+0000 7f766ffff700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f765c08e8b0 0x7f765c090d60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.197+0000 7f766ffff700 1 --2- 172.21.15.115:0/1913721908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7670068ce0 0x7f767013b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.197+0000 7f766ffff700 1 -- 172.21.15.115:0/1913721908 >> 172.21.15.115:0/1913721908 conn(0x7f7670069520 msgr2=0x7f767013c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:04.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.197+0000 7f766ffff700 1 -- 172.21.15.115:0/1913721908 shutdown_connections 2023-09-29T23:05:04.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.197+0000 7f766ffff700 1 -- 172.21.15.115:0/1913721908 wait complete. 2023-09-29T23:05:04.202 INFO:teuthology.orchestra.run.smithi115.stderr:new fs with metadata pool 3 and data pool 4 2023-09-29T23:05:04.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:05:04.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f94a5a90700 1 Processor -- start 2023-09-29T23:05:04.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f94a5a90700 1 -- start start 2023-09-29T23:05:04.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f94a5a90700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94a0069c90 0x7f94a009c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f94a5a90700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a013d150 con 0x7f94a009d470 2023-09-29T23:05:04.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f94a5a90700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a006a940 con 0x7f94a009dc30 2023-09-29T23:05:04.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f94a5a90700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a009ea40 con 0x7f94a0069c90 2023-09-29T23:05:04.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f94a4a8e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94a0069c90 0x7f94a009c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f94a528f700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f94a009d470 0x7f94a013ca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41620/0 (socket says 172.21.15.115:41620) 2023-09-29T23:05:04.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f94a528f700 1 -- 172.21.15.115:0/676245159 learned_addr learned my addr 172.21.15.115:0/676245159 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:04.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f949f7fe700 1 -- 172.21.15.115:0/676245159 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588826186 0 0) 0x7f94a013d150 con 0x7f94a009d470 2023-09-29T23:05:04.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f949f7fe700 1 -- 172.21.15.115:0/676245159 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9490003570 con 0x7f94a009d470 2023-09-29T23:05:04.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f94a4a8e700 1 -- 172.21.15.115:0/676245159 >> v1:172.21.15.156:6789/0 conn(0x7f94a009dc30 legacy=0x7f94a009e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f94a4a8e700 1 -- 172.21.15.115:0/676245159 >> v1:172.21.15.115:6789/0 conn(0x7f94a009d470 legacy=0x7f94a013ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f94a4a8e700 1 -- 172.21.15.115:0/676245159 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a006a060 con 0x7f94a0069c90 2023-09-29T23:05:04.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f94a4a8e700 1 --2- 172.21.15.115:0/676245159 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94a0069c90 0x7f94a009c3a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f948c009910 tx=0x7f948c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40002bd4967bb12c server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:04.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f949f7fe700 1 -- 172.21.15.115:0/676245159 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00b680 con 0x7f94a0069c90 2023-09-29T23:05:04.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f949f7fe700 1 -- 172.21.15.115:0/676245159 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c00b7e0 con 0x7f94a0069c90 2023-09-29T23:05:04.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.309+0000 7f949f7fe700 1 -- 172.21.15.115:0/676245159 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00bba0 con 0x7f94a0069c90 2023-09-29T23:05:04.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 -- 172.21.15.115:0/676245159 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94a0069c90 msgr2=0x7f94a009c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 --2- 172.21.15.115:0/676245159 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94a0069c90 0x7f94a009c3a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f948c009910 tx=0x7f948c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 -- 172.21.15.115:0/676245159 shutdown_connections 2023-09-29T23:05:04.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 --2- 172.21.15.115:0/676245159 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94a0069c90 0x7f94a009c3a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 -- 172.21.15.115:0/676245159 >> 172.21.15.115:0/676245159 conn(0x7f94a00a2a60 msgr2=0x7f94a00a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:04.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 -- 172.21.15.115:0/676245159 shutdown_connections 2023-09-29T23:05:04.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 -- 172.21.15.115:0/676245159 wait complete. 2023-09-29T23:05:04.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 Processor -- start 2023-09-29T23:05:04.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 -- start start 2023-09-29T23:05:04.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94a0069c90 0x7f94a00a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94a009d470 0x7f94a01351c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94a009dc30 0x7f94a00b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a0139b80 con 0x7f94a009d470 2023-09-29T23:05:04.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a0135b40 con 0x7f94a009dc30 2023-09-29T23:05:04.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a5a90700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a00b1ff0 con 0x7f94a0069c90 2023-09-29T23:05:04.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a4a8e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94a0069c90 0x7f94a00a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a4a8e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94a0069c90 0x7f94a00a1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:32984/0 (socket says 172.21.15.115:32984) 2023-09-29T23:05:04.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a4a8e700 1 -- 172.21.15.115:0/3062649455 learned_addr learned my addr 172.21.15.115:0/3062649455 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:04.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f949ffff700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94a009d470 0x7f94a01351c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a528f700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94a009dc30 0x7f94a00b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a4a8e700 1 -- 172.21.15.115:0/3062649455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94a009dc30 msgr2=0x7f94a00b0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a4a8e700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94a009dc30 0x7f94a00b0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a4a8e700 1 -- 172.21.15.115:0/3062649455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94a009d470 msgr2=0x7f94a01351c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a4a8e700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94a009d470 0x7f94a01351c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a4a8e700 1 -- 172.21.15.115:0/3062649455 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c009420 con 0x7f94a0069c90 2023-09-29T23:05:04.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a528f700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94a009dc30 0x7f94a00b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:05:04.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f94a4a8e700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94a0069c90 0x7f94a00a1950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f948c009fb0 tx=0x7f948c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:04.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.313+0000 7f949cff9700 1 -- 172.21.15.115:0/3062649455 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00bb60 con 0x7f94a0069c90 2023-09-29T23:05:04.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.317+0000 7f949cff9700 1 -- 172.21.15.115:0/3062649455 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c000c90 con 0x7f94a0069c90 2023-09-29T23:05:04.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.317+0000 7f94a5a90700 1 -- 172.21.15.115:0/3062649455 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a00b18b0 con 0x7f94a0069c90 2023-09-29T23:05:04.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.317+0000 7f949cff9700 1 -- 172.21.15.115:0/3062649455 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c01a660 con 0x7f94a0069c90 2023-09-29T23:05:04.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.317+0000 7f94a5a90700 1 -- 172.21.15.115:0/3062649455 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a01349e0 con 0x7f94a0069c90 2023-09-29T23:05:04.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.317+0000 7f94a5a90700 1 -- 172.21.15.115:0/3062649455 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a004be00 con 0x7f94a0069c90 2023-09-29T23:05:04.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.317+0000 7f949cff9700 1 -- 172.21.15.115:0/3062649455 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f948c01a9d0 con 0x7f94a0069c90 2023-09-29T23:05:04.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.317+0000 7f949cff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:04.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.317+0000 7f949cff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:04.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.317+0000 7f949cff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:04.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.317+0000 7f949cff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:04.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.317+0000 7f949cff9700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f948408e830 0x7f9484090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.317+0000 7f949cff9700 1 -- 172.21.15.115:0/3062649455 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f948c0b6c50 con 0x7f94a0069c90 2023-09-29T23:05:04.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.317+0000 7f949ffff700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f948408e830 0x7f9484090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.321+0000 7f949ffff700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f948408e830 0x7f9484090ce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f94a00b1ee0 tx=0x7f9494007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:04.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.325+0000 7f949cff9700 1 -- 172.21.15.115:0/3062649455 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f948c087710 con 0x7f94a0069c90 2023-09-29T23:05:04.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.489+0000 7f94a5a90700 1 -- 172.21.15.115:0/3062649455 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94a009ef10 con 0x7f94a0069c90 2023-09-29T23:05:04.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.489+0000 7f949cff9700 1 -- 172.21.15.115:0/3062649455 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12219 (secure 0 0 0) 0x7f948c015090 con 0x7f94a0069c90 2023-09-29T23:05:04.491 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:04.491 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":19,"fsid":"593687ae-01c7-4a32-a91e-931db75fb751","created":"2023-09-29T23:04:48.574873+0000","modified":"2023-09-29T23:05:04.185043+0000","last_up_change":"2023-09-29T23:04:53.614158+0000","last_in_change":"2023-09-29T23:04:50.489116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-29T23:04:54.900033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-29T23:04:58.342574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-29T23:05:02.595115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-29T23:05:03.183110+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9da0e8c9-ea18-4691-87ef-fbf5502845a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":26662},{"type":"v1","addr":"172.21.15.115:6801","nonce":26662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":26662},{"type":"v1","addr":"172.21.15.115:6803","nonce":26662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":26662},{"type":"v1","addr":"172.21.15.115:6807","nonce":26662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":26662},{"type":"v1","addr":"172.21.15.115:6805","nonce":26662}]},"public_addr":"172.21.15.115:6801/26662","cluster_addr":"172.21.15.115:6803/26662","heartbeat_back_addr":"172.21.15.115:6807/26662","heartbeat_front_addr":"172.21.15.115:6805/26662","state":["exists","up"]},{"osd":1,"uuid":"eaaa380c-73da-4075-992d-ab16b36d8ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":26874},{"type":"v1","addr":"172.21.15.156:6801","nonce":26874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":26874},{"type":"v1","addr":"172.21.15.156:6803","nonce":26874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":26874},{"type":"v1","addr":"172.21.15.156:6807","nonce":26874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":26874},{"type":"v1","addr":"172.21.15.156:6805","nonce":26874}]},"public_addr":"172.21.15.156:6801/26874","cluster_addr":"172.21.15.156:6803/26874","heartbeat_back_addr":"172.21.15.156:6807/26874","heartbeat_front_addr":"172.21.15.156:6805/26874","state":["exists","up"]},{"osd":2,"uuid":"01e8286e-30af-41c7-bcd1-c4545f9f0a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":26873},{"type":"v1","addr":"172.21.15.156:6809","nonce":26873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":26873},{"type":"v1","addr":"172.21.15.156:6811","nonce":26873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":26873},{"type":"v1","addr":"172.21.15.156:6817","nonce":26873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":26873},{"type":"v1","addr":"172.21.15.156:6813","nonce":26873}]},"public_addr":"172.21.15.156:6809/26873","cluster_addr":"172.21.15.156:6811/26873","heartbeat_back_addr":"172.21.15.156:6817/26873","heartbeat_front_addr":"172.21.15.156:6813/26873","state":["exists","up"]},{"osd":3,"uuid":"4f6a1234-5ac6-43b0-baaa-3567ab7c73a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6815","nonce":26875},{"type":"v1","addr":"172.21.15.156:6816","nonce":26875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":26875},{"type":"v1","addr":"172.21.15.156:6819","nonce":26875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":26875},{"type":"v1","addr":"172.21.15.156:6823","nonce":26875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":26875},{"type":"v1","addr":"172.21.15.156:6821","nonce":26875}]},"public_addr":"172.21.15.156:6816/26875","cluster_addr":"172.21.15.156:6819/26875","heartbeat_back_addr":"172.21.15.156:6823/26875","heartbeat_front_addr":"172.21.15.156:6821/26875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.582513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.686413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:05:04.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.489+0000 7f94a5a90700 10 mgrc shutdown 2023-09-29T23:05:04.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.489+0000 7f94a5a90700 1 -- 172.21.15.115:0/3062649455 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f948408e830 msgr2=0x7f9484090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.489+0000 7f94a5a90700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f948408e830 0x7f9484090ce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f94a00b1ee0 tx=0x7f9494007ec0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.489+0000 7f94a5a90700 1 -- 172.21.15.115:0/3062649455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94a0069c90 msgr2=0x7f94a00a1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.489+0000 7f94a5a90700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94a0069c90 0x7f94a00a1950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f948c009fb0 tx=0x7f948c017000 comp rx=0 tx=0).stop 2023-09-29T23:05:04.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.493+0000 7f94a5a90700 1 -- 172.21.15.115:0/3062649455 shutdown_connections 2023-09-29T23:05:04.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.493+0000 7f94a5a90700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94a009dc30 0x7f94a00b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.493+0000 7f94a5a90700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f948408e830 0x7f9484090ce0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.493+0000 7f94a5a90700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94a009d470 0x7f94a01351c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.493+0000 7f94a5a90700 1 --2- 172.21.15.115:0/3062649455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94a0069c90 0x7f94a00a1950 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.493+0000 7f94a5a90700 1 -- 172.21.15.115:0/3062649455 >> 172.21.15.115:0/3062649455 conn(0x7f94a00a2a60 msgr2=0x7f94a009e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:04.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.493+0000 7f94a5a90700 1 -- 172.21.15.115:0/3062649455 shutdown_connections 2023-09-29T23:05:04.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.493+0000 7f94a5a90700 1 -- 172.21.15.115:0/3062649455 wait complete. 2023-09-29T23:05:04.506 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:05:04.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfeeff700 1 Processor -- start 2023-09-29T23:05:04.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfeeff700 1 -- start start 2023-09-29T23:05:04.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfeeff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2df80a4d40 0x7f2df809b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfeeff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2df8147850 0x7f2df814e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfeeff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df806fbe0 con 0x7f2df8147450 2023-09-29T23:05:04.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfeeff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df8141910 con 0x7f2df80a4d40 2023-09-29T23:05:04.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfeeff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df809b660 con 0x7f2df8147850 2023-09-29T23:05:04.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfcc9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2df80a4d40 0x7f2df809b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2df7fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2df8147450 0x7f2df80a3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41632/0 (socket says 172.21.15.115:41632) 2023-09-29T23:05:04.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2df7fff700 1 -- 172.21.15.115:0/973671663 learned_addr learned my addr 172.21.15.115:0/973671663 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:04.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfd49c700 1 --2- 172.21.15.115:0/973671663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2df8147850 0x7f2df814e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.612 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfcc9b700 1 -- 172.21.15.115:0/973671663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2df8147850 msgr2=0x7f2df814e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:04.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2df77fe700 1 -- 172.21.15.115:0/973671663 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502818642 0 0) 0x7f2df806fbe0 con 0x7f2df8147450 2023-09-29T23:05:04.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfcc9b700 1 --2- 172.21.15.115:0/973671663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2df8147850 0x7f2df814e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfcc9b700 1 -- 172.21.15.115:0/973671663 >> v1:172.21.15.115:6789/0 conn(0x7f2df8147450 legacy=0x7f2df80a3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfcc9b700 1 -- 172.21.15.115:0/973671663 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df80a5110 con 0x7f2df80a4d40 2023-09-29T23:05:04.613 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2dfcc9b700 1 --2- 172.21.15.115:0/973671663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df80a4d40 0x7f2df809b040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2de00098e0 tx=0x7f2de00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1b1b478acd2e40 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:04.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2df77fe700 1 -- 172.21.15.115:0/973671663 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000b640 con 0x7f2df80a4d40 2023-09-29T23:05:04.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2df77fe700 1 -- 172.21.15.115:0/973671663 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de000b7a0 con 0x7f2df80a4d40 2023-09-29T23:05:04.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.609+0000 7f2df77fe700 1 -- 172.21.15.115:0/973671663 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000bb40 con 0x7f2df80a4d40 2023-09-29T23:05:04.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 -- 172.21.15.115:0/973671663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df80a4d40 msgr2=0x7f2df809b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 --2- 172.21.15.115:0/973671663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df80a4d40 0x7f2df809b040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2de00098e0 tx=0x7f2de00091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 -- 172.21.15.115:0/973671663 shutdown_connections 2023-09-29T23:05:04.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 --2- 172.21.15.115:0/973671663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2df8147850 0x7f2df814e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 --2- 172.21.15.115:0/973671663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df80a4d40 0x7f2df809b040 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 -- 172.21.15.115:0/973671663 >> 172.21.15.115:0/973671663 conn(0x7f2df80695c0 msgr2=0x7f2df80699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:04.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 -- 172.21.15.115:0/973671663 shutdown_connections 2023-09-29T23:05:04.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 -- 172.21.15.115:0/973671663 wait complete. 2023-09-29T23:05:04.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 Processor -- start 2023-09-29T23:05:04.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 -- start start 2023-09-29T23:05:04.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2df80a4d40 0x7f2df809fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2df8147450 0x7f2df81406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df8147850 0x7f2df8140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df809f260 con 0x7f2df8147850 2023-09-29T23:05:04.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df809c5e0 con 0x7f2df80a4d40 2023-09-29T23:05:04.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.613+0000 7f2dfeeff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df809ed60 con 0x7f2df8147450 2023-09-29T23:05:04.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2dfd49c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df8147850 0x7f2df8140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2df7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2df8147450 0x7f2df81406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2dfd49c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df8147850 0x7f2df8140c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40686/0 (socket says 172.21.15.115:40686) 2023-09-29T23:05:04.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2dfd49c700 1 -- 172.21.15.115:0/1884810950 learned_addr learned my addr 172.21.15.115:0/1884810950 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:04.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2dfcc9b700 1 --2- 172.21.15.115:0/1884810950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2df80a4d40 0x7f2df809fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2dfd49c700 1 -- 172.21.15.115:0/1884810950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2df8147450 msgr2=0x7f2df81406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2dfd49c700 1 --2- 172.21.15.115:0/1884810950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2df8147450 0x7f2df81406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2dfd49c700 1 -- 172.21.15.115:0/1884810950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2df80a4d40 msgr2=0x7f2df809fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2dfd49c700 1 --2- 172.21.15.115:0/1884810950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2df80a4d40 0x7f2df809fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2dfd49c700 1 -- 172.21.15.115:0/1884810950 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de0009420 con 0x7f2df8147850 2023-09-29T23:05:04.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2dfd49c700 1 --2- 172.21.15.115:0/1884810950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df8147850 0x7f2df8140c10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2df0009e90 tx=0x7f2df000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:04.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2df4ff9700 1 -- 172.21.15.115:0/1884810950 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df000cc20 con 0x7f2df8147850 2023-09-29T23:05:04.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2df4ff9700 1 -- 172.21.15.115:0/1884810950 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df000f040 con 0x7f2df8147850 2023-09-29T23:05:04.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2df4ff9700 1 -- 172.21.15.115:0/1884810950 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df0014480 con 0x7f2df8147850 2023-09-29T23:05:04.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2dfeeff700 1 -- 172.21.15.115:0/1884810950 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df809d870 con 0x7f2df8147850 2023-09-29T23:05:04.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2dfeeff700 1 -- 172.21.15.115:0/1884810950 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df809f4b0 con 0x7f2df8147850 2023-09-29T23:05:04.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.617+0000 7f2dfeeff700 1 -- 172.21.15.115:0/1884810950 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df8070990 con 0x7f2df8147850 2023-09-29T23:05:04.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.621+0000 7f2df4ff9700 1 -- 172.21.15.115:0/1884810950 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f2df00147f0 con 0x7f2df8147850 2023-09-29T23:05:04.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.621+0000 7f2df4ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:04.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.621+0000 7f2df4ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:04.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.621+0000 7f2df4ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:04.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.621+0000 7f2df4ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:04.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.621+0000 7f2df4ff9700 1 --2- 172.21.15.115:0/1884810950 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2dd808e8b0 0x7f2dd8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.621+0000 7f2dfcc9b700 1 --2- 172.21.15.115:0/1884810950 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2dd808e8b0 0x7f2dd8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.621+0000 7f2df4ff9700 1 -- 172.21.15.115:0/1884810950 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f2df00b5d60 con 0x7f2df8147850 2023-09-29T23:05:04.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.621+0000 7f2dfcc9b700 1 --2- 172.21.15.115:0/1884810950 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2dd808e8b0 0x7f2dd8090d60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2de00091e0 tx=0x7f2de0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:04.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.629+0000 7f2df4ff9700 1 -- 172.21.15.115:0/1884810950 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2df008a2b0 con 0x7f2df8147850 2023-09-29T23:05:04.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.793+0000 7f2dfeeff700 1 -- 172.21.15.115:0/1884810950 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2df8147dd0 con 0x7f2df8147850 2023-09-29T23:05:04.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.793+0000 7f2df4ff9700 1 -- 172.21.15.115:0/1884810950 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12219 (secure 0 0 0) 0x7f2df0018020 con 0x7f2df8147850 2023-09-29T23:05:04.797 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:04.797 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":19,"fsid":"593687ae-01c7-4a32-a91e-931db75fb751","created":"2023-09-29T23:04:48.574873+0000","modified":"2023-09-29T23:05:04.185043+0000","last_up_change":"2023-09-29T23:04:53.614158+0000","last_in_change":"2023-09-29T23:04:50.489116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-29T23:04:54.900033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-29T23:04:58.342574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-29T23:05:02.595115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-29T23:05:03.183110+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9da0e8c9-ea18-4691-87ef-fbf5502845a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":26662},{"type":"v1","addr":"172.21.15.115:6801","nonce":26662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":26662},{"type":"v1","addr":"172.21.15.115:6803","nonce":26662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":26662},{"type":"v1","addr":"172.21.15.115:6807","nonce":26662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":26662},{"type":"v1","addr":"172.21.15.115:6805","nonce":26662}]},"public_addr":"172.21.15.115:6801/26662","cluster_addr":"172.21.15.115:6803/26662","heartbeat_back_addr":"172.21.15.115:6807/26662","heartbeat_front_addr":"172.21.15.115:6805/26662","state":["exists","up"]},{"osd":1,"uuid":"eaaa380c-73da-4075-992d-ab16b36d8ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":26874},{"type":"v1","addr":"172.21.15.156:6801","nonce":26874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":26874},{"type":"v1","addr":"172.21.15.156:6803","nonce":26874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":26874},{"type":"v1","addr":"172.21.15.156:6807","nonce":26874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":26874},{"type":"v1","addr":"172.21.15.156:6805","nonce":26874}]},"public_addr":"172.21.15.156:6801/26874","cluster_addr":"172.21.15.156:6803/26874","heartbeat_back_addr":"172.21.15.156:6807/26874","heartbeat_front_addr":"172.21.15.156:6805/26874","state":["exists","up"]},{"osd":2,"uuid":"01e8286e-30af-41c7-bcd1-c4545f9f0a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":26873},{"type":"v1","addr":"172.21.15.156:6809","nonce":26873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":26873},{"type":"v1","addr":"172.21.15.156:6811","nonce":26873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":26873},{"type":"v1","addr":"172.21.15.156:6817","nonce":26873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":26873},{"type":"v1","addr":"172.21.15.156:6813","nonce":26873}]},"public_addr":"172.21.15.156:6809/26873","cluster_addr":"172.21.15.156:6811/26873","heartbeat_back_addr":"172.21.15.156:6817/26873","heartbeat_front_addr":"172.21.15.156:6813/26873","state":["exists","up"]},{"osd":3,"uuid":"4f6a1234-5ac6-43b0-baaa-3567ab7c73a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6815","nonce":26875},{"type":"v1","addr":"172.21.15.156:6816","nonce":26875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":26875},{"type":"v1","addr":"172.21.15.156:6819","nonce":26875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":26875},{"type":"v1","addr":"172.21.15.156:6823","nonce":26875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":26875},{"type":"v1","addr":"172.21.15.156:6821","nonce":26875}]},"public_addr":"172.21.15.156:6816/26875","cluster_addr":"172.21.15.156:6819/26875","heartbeat_back_addr":"172.21.15.156:6823/26875","heartbeat_front_addr":"172.21.15.156:6821/26875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.582513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.686413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:05:04.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.797+0000 7f2dfeeff700 10 mgrc shutdown 2023-09-29T23:05:04.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.797+0000 7f2dfeeff700 1 -- 172.21.15.115:0/1884810950 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2dd808e8b0 msgr2=0x7f2dd8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.797+0000 7f2dfeeff700 1 --2- 172.21.15.115:0/1884810950 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2dd808e8b0 0x7f2dd8090d60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2de00091e0 tx=0x7f2de0017000 comp rx=0 tx=0).stop 2023-09-29T23:05:04.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.797+0000 7f2dfeeff700 1 -- 172.21.15.115:0/1884810950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df8147850 msgr2=0x7f2df8140c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.797+0000 7f2dfeeff700 1 --2- 172.21.15.115:0/1884810950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df8147850 0x7f2df8140c10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2df0009e90 tx=0x7f2df000b040 comp rx=0 tx=0).stop 2023-09-29T23:05:04.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.797+0000 7f2dfeeff700 1 -- 172.21.15.115:0/1884810950 shutdown_connections 2023-09-29T23:05:04.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.797+0000 7f2dfeeff700 1 --2- 172.21.15.115:0/1884810950 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2dd808e8b0 0x7f2dd8090d60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.797+0000 7f2dfeeff700 1 --2- 172.21.15.115:0/1884810950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df8147850 0x7f2df8140c10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.797+0000 7f2dfeeff700 1 --2- 172.21.15.115:0/1884810950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2df8147450 0x7f2df81406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.797+0000 7f2dfeeff700 1 --2- 172.21.15.115:0/1884810950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2df80a4d40 0x7f2df809fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.797+0000 7f2dfeeff700 1 -- 172.21.15.115:0/1884810950 >> 172.21.15.115:0/1884810950 conn(0x7f2df80695c0 msgr2=0x7f2df81445f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:04.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.797+0000 7f2dfeeff700 1 -- 172.21.15.115:0/1884810950 shutdown_connections 2023-09-29T23:05:04.800 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.797+0000 7f2dfeeff700 1 -- 172.21.15.115:0/1884810950 wait complete. 2023-09-29T23:05:04.811 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-29T23:05:04.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f274157f700 1 Processor -- start 2023-09-29T23:05:04.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f274157f700 1 -- start start 2023-09-29T23:05:04.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f274157f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 0x7f273c0a3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f274157f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f273c0a5170 0x7f273c0a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f274157f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c068f40 con 0x7f273c06e9f0 2023-09-29T23:05:04.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f274157f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273c0a4d00 con 0x7f273c0a5170 2023-09-29T23:05:04.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f274157f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c06efc0 con 0x7f273c068b70 2023-09-29T23:05:04.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f273affd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 0x7f273c0a3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f273b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f273c06e9f0 0x7f273c13b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41640/0 (socket says 172.21.15.115:41640) 2023-09-29T23:05:04.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f273affd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 0x7f273c0a3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33012/0 (socket says 172.21.15.115:33012) 2023-09-29T23:05:04.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f273a7fc700 1 --2- 172.21.15.115:0/3673512546 >> v2:172.21.15.156:3300/0 conn(0x7f273c0a5170 0x7f273c0a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f273b7fe700 1 -- 172.21.15.115:0/3673512546 learned_addr learned my addr 172.21.15.115:0/3673512546 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:04.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f273affd700 1 -- 172.21.15.115:0/3673512546 >> v2:172.21.15.156:3300/0 conn(0x7f273c0a5170 msgr2=0x7f273c0a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:04.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f273affd700 1 --2- 172.21.15.115:0/3673512546 >> v2:172.21.15.156:3300/0 conn(0x7f273c0a5170 0x7f273c0a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f273affd700 1 -- 172.21.15.115:0/3673512546 >> v1:172.21.15.115:6789/0 conn(0x7f273c06e9f0 legacy=0x7f273c13b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f273affd700 1 -- 172.21.15.115:0/3673512546 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c06f280 con 0x7f273c068b70 2023-09-29T23:05:04.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f273affd700 1 --2- 172.21.15.115:0/3673512546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 0x7f273c0a3110 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f273c06f470 tx=0x7f27240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69ec2398747b087a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:04.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f2739ffb700 1 -- 172.21.15.115:0/3673512546 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724011630 con 0x7f273c068b70 2023-09-29T23:05:04.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f2739ffb700 1 -- 172.21.15.115:0/3673512546 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2724011790 con 0x7f273c068b70 2023-09-29T23:05:04.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.925+0000 7f2739ffb700 1 -- 172.21.15.115:0/3673512546 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724011b50 con 0x7f273c068b70 2023-09-29T23:05:04.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 -- 172.21.15.115:0/3673512546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 msgr2=0x7f273c0a3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 --2- 172.21.15.115:0/3673512546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 0x7f273c0a3110 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f273c06f470 tx=0x7f27240091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 -- 172.21.15.115:0/3673512546 shutdown_connections 2023-09-29T23:05:04.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 --2- 172.21.15.115:0/3673512546 >> v2:172.21.15.156:3300/0 conn(0x7f273c0a5170 0x7f273c0a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 --2- 172.21.15.115:0/3673512546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 0x7f273c0a3110 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 -- 172.21.15.115:0/3673512546 >> 172.21.15.115:0/3673512546 conn(0x7f273c06a890 msgr2=0x7f273c0b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:04.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 -- 172.21.15.115:0/3673512546 shutdown_connections 2023-09-29T23:05:04.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 -- 172.21.15.115:0/3673512546 wait complete. 2023-09-29T23:05:04.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 Processor -- start 2023-09-29T23:05:04.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 -- start start 2023-09-29T23:05:04.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 0x7f273c1363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f273c06e9f0 0x7f273c0a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f273c0a5170 0x7f273c0a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c1413c0 con 0x7f273c06e9f0 2023-09-29T23:05:04.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0a1180 con 0x7f273c0a5170 2023-09-29T23:05:04.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c141870 con 0x7f273c068b70 2023-09-29T23:05:04.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f273affd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 0x7f273c1363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f273a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f273c06e9f0 0x7f273c0a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f273affd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 0x7f273c1363d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33024/0 (socket says 172.21.15.115:33024) 2023-09-29T23:05:04.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f273affd700 1 -- 172.21.15.115:0/4000728208 learned_addr learned my addr 172.21.15.115:0/4000728208 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:04.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f273b7fe700 1 --2- 172.21.15.115:0/4000728208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f273c0a5170 0x7f273c0a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f273affd700 1 -- 172.21.15.115:0/4000728208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f273c0a5170 msgr2=0x7f273c0a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f273affd700 1 --2- 172.21.15.115:0/4000728208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f273c0a5170 0x7f273c0a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f273affd700 1 -- 172.21.15.115:0/4000728208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f273c06e9f0 msgr2=0x7f273c0a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:04.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f273affd700 1 --2- 172.21.15.115:0/4000728208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f273c06e9f0 0x7f273c0a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:04.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f273affd700 1 -- 172.21.15.115:0/4000728208 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2724009420 con 0x7f273c068b70 2023-09-29T23:05:04.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f273affd700 1 --2- 172.21.15.115:0/4000728208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 0x7f273c1363d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f273c069a30 tx=0x7f2724016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:04.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f2732ffd700 1 -- 172.21.15.115:0/4000728208 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272401ad00 con 0x7f273c068b70 2023-09-29T23:05:04.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f2732ffd700 1 -- 172.21.15.115:0/4000728208 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272401ae80 con 0x7f273c068b70 2023-09-29T23:05:04.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f2732ffd700 1 -- 172.21.15.115:0/4000728208 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272401b6a0 con 0x7f273c068b70 2023-09-29T23:05:04.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.929+0000 7f274157f700 1 -- 172.21.15.115:0/4000728208 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c136910 con 0x7f273c068b70 2023-09-29T23:05:04.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.933+0000 7f274157f700 1 -- 172.21.15.115:0/4000728208 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c1313b0 con 0x7f273c068b70 2023-09-29T23:05:04.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.933+0000 7f274157f700 1 -- 172.21.15.115:0/4000728208 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273c070990 con 0x7f273c068b70 2023-09-29T23:05:04.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.933+0000 7f2732ffd700 1 -- 172.21.15.115:0/4000728208 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f272401bad0 con 0x7f273c068b70 2023-09-29T23:05:04.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.933+0000 7f2732ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:04.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.933+0000 7f2732ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:04.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.933+0000 7f2732ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:04.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.933+0000 7f2732ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:04.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.933+0000 7f2732ffd700 1 --2- 172.21.15.115:0/4000728208 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f271c08e830 0x7f271c090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:04.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.933+0000 7f2732ffd700 1 -- 172.21.15.115:0/4000728208 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f27240b5a10 con 0x7f273c068b70 2023-09-29T23:05:04.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.933+0000 7f273a7fc700 1 --2- 172.21.15.115:0/4000728208 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f271c08e830 0x7f271c090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:04.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.937+0000 7f273a7fc700 1 --2- 172.21.15.115:0/4000728208 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f271c08e830 0x7f271c090ce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f273c0a5760 tx=0x7f272c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:04.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:04.941+0000 7f2732ffd700 1 -- 172.21.15.115:0/4000728208 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f27240864d0 con 0x7f273c068b70 2023-09-29T23:05:05.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.141+0000 7f274157f700 1 -- 172.21.15.115:0/4000728208 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f273c0a4230 con 0x7f273c068b70 2023-09-29T23:05:05.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.193+0000 7f2732ffd700 1 -- 172.21.15.115:0/4000728208 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f27240200b0 con 0x7f273c068b70 2023-09-29T23:05:05.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.197+0000 7f274157f700 10 mgrc shutdown 2023-09-29T23:05:05.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.197+0000 7f274157f700 1 -- 172.21.15.115:0/4000728208 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f271c08e830 msgr2=0x7f271c090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:05.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.197+0000 7f274157f700 1 --2- 172.21.15.115:0/4000728208 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f271c08e830 0x7f271c090ce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f273c0a5760 tx=0x7f272c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:05.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.197+0000 7f274157f700 1 -- 172.21.15.115:0/4000728208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 msgr2=0x7f273c1363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:05.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.197+0000 7f274157f700 1 --2- 172.21.15.115:0/4000728208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 0x7f273c1363d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f273c069a30 tx=0x7f2724016000 comp rx=0 tx=0).stop 2023-09-29T23:05:05.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.197+0000 7f274157f700 1 -- 172.21.15.115:0/4000728208 shutdown_connections 2023-09-29T23:05:05.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.197+0000 7f274157f700 1 --2- 172.21.15.115:0/4000728208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f273c0a5170 0x7f273c0a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:05.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.197+0000 7f274157f700 1 --2- 172.21.15.115:0/4000728208 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f271c08e830 0x7f271c090ce0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:05.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.197+0000 7f274157f700 1 --2- 172.21.15.115:0/4000728208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f273c06e9f0 0x7f273c0a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:05.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.197+0000 7f274157f700 1 --2- 172.21.15.115:0/4000728208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f273c068b70 0x7f273c1363d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:05.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.197+0000 7f274157f700 1 -- 172.21.15.115:0/4000728208 >> 172.21.15.115:0/4000728208 conn(0x7f273c06a890 msgr2=0x7f273c06cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:05.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.197+0000 7f274157f700 1 -- 172.21.15.115:0/4000728208 shutdown_connections 2023-09-29T23:05:05.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.197+0000 7f274157f700 1 -- 172.21.15.115:0/4000728208 wait complete. 2023-09-29T23:05:05.217 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-29T23:05:05.218 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-29T23:05:05.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.321+0000 7fd466235700 1 Processor -- start 2023-09-29T23:05:05.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.321+0000 7fd466235700 1 -- start start 2023-09-29T23:05:05.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.321+0000 7fd466235700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd460068e30 0x7fd4600a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:05.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.321+0000 7fd466235700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd4600a0030 0x7fd46013f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:05.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.321+0000 7fd466235700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4600a0430 0x7fd46013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:05.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.321+0000 7fd466235700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46009fc00 con 0x7fd460068e30 2023-09-29T23:05:05.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.321+0000 7fd466235700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd460069200 con 0x7fd4600a0030 2023-09-29T23:05:05.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.321+0000 7fd466235700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600a1df0 con 0x7fd4600a0430 2023-09-29T23:05:05.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4600a0430 0x7fd46013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:05.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4600a0430 0x7fd46013f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33036/0 (socket says 172.21.15.115:33036) 2023-09-29T23:05:05.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45ffff700 1 -- 172.21.15.115:0/1367841587 learned_addr learned my addr 172.21.15.115:0/1367841587 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:05.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45f7fe700 1 --2- 172.21.15.115:0/1367841587 >> v2:172.21.15.115:3300/0 conn(0x7fd460068e30 0x7fd4600a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45effd700 1 --2- 172.21.15.115:0/1367841587 >> v2:172.21.15.156:3300/0 conn(0x7fd4600a0030 0x7fd46013f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45ffff700 1 -- 172.21.15.115:0/1367841587 >> v2:172.21.15.156:3300/0 conn(0x7fd4600a0030 msgr2=0x7fd46013f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45ffff700 1 --2- 172.21.15.115:0/1367841587 >> v2:172.21.15.156:3300/0 conn(0x7fd4600a0030 0x7fd46013f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45ffff700 1 -- 172.21.15.115:0/1367841587 >> v2:172.21.15.115:3300/0 conn(0x7fd460068e30 msgr2=0x7fd4600a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45ffff700 1 --2- 172.21.15.115:0/1367841587 >> v2:172.21.15.115:3300/0 conn(0x7fd460068e30 0x7fd4600a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45ffff700 1 -- 172.21.15.115:0/1367841587 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4600b6a60 con 0x7fd4600a0430 2023-09-29T23:05:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45f7fe700 1 --2- 172.21.15.115:0/1367841587 >> v2:172.21.15.115:3300/0 conn(0x7fd460068e30 0x7fd4600a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45ffff700 1 --2- 172.21.15.115:0/1367841587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4600a0430 0x7fd46013f5f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd458009f20 tx=0x7fd458009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c2ee059225e9c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45e7fc700 1 -- 172.21.15.115:0/1367841587 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45800e070 con 0x7fd4600a0430 2023-09-29T23:05:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45e7fc700 1 -- 172.21.15.115:0/1367841587 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45800ba40 con 0x7fd4600a0430 2023-09-29T23:05:05.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd45e7fc700 1 -- 172.21.15.115:0/1367841587 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4580092e0 con 0x7fd4600a0430 2023-09-29T23:05:05.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd466235700 1 -- 172.21.15.115:0/1367841587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4600a0430 msgr2=0x7fd46013f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:05.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd466235700 1 --2- 172.21.15.115:0/1367841587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4600a0430 0x7fd46013f5f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd458009f20 tx=0x7fd458009840 comp rx=0 tx=0).stop 2023-09-29T23:05:05.329 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd466235700 1 -- 172.21.15.115:0/1367841587 shutdown_connections 2023-09-29T23:05:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd466235700 1 --2- 172.21.15.115:0/1367841587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4600a0430 0x7fd46013f5f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd466235700 1 --2- 172.21.15.115:0/1367841587 >> v2:172.21.15.156:3300/0 conn(0x7fd4600a0030 0x7fd46013f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd466235700 1 --2- 172.21.15.115:0/1367841587 >> v2:172.21.15.115:3300/0 conn(0x7fd460068e30 0x7fd4600a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd466235700 1 -- 172.21.15.115:0/1367841587 >> 172.21.15.115:0/1367841587 conn(0x7fd460069670 msgr2=0x7fd4600684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd466235700 1 -- 172.21.15.115:0/1367841587 shutdown_connections 2023-09-29T23:05:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd466235700 1 -- 172.21.15.115:0/1367841587 wait complete. 2023-09-29T23:05:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd466235700 1 Processor -- start 2023-09-29T23:05:05.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.325+0000 7fd466235700 1 -- start start 2023-09-29T23:05:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd466235700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd460068e30 0x7fd4600aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd466235700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4600a0030 0x7fd460142760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd466235700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4600a0430 0x7fd460142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd466235700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600a5b70 con 0x7fd4600a0430 2023-09-29T23:05:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd466235700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600a36a0 con 0x7fd4600a0030 2023-09-29T23:05:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd466235700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd460143370 con 0x7fd460068e30 2023-09-29T23:05:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd460068e30 0x7fd4600aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd45ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4600a0430 0x7fd460142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:05.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd460068e30 0x7fd4600aa070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33050/0 (socket says 172.21.15.115:33050) 2023-09-29T23:05:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd45f7fe700 1 -- 172.21.15.115:0/3174895807 learned_addr learned my addr 172.21.15.115:0/3174895807 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd45effd700 1 --2- 172.21.15.115:0/3174895807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4600a0030 0x7fd460142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd45f7fe700 1 -- 172.21.15.115:0/3174895807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4600a0030 msgr2=0x7fd460142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd45f7fe700 1 --2- 172.21.15.115:0/3174895807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4600a0030 0x7fd460142760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd45f7fe700 1 -- 172.21.15.115:0/3174895807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4600a0430 msgr2=0x7fd460142ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd45f7fe700 1 --2- 172.21.15.115:0/3174895807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4600a0430 0x7fd460142ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd45f7fe700 1 -- 172.21.15.115:0/3174895807 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458009ae0 con 0x7fd460068e30 2023-09-29T23:05:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd45f7fe700 1 --2- 172.21.15.115:0/3174895807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd460068e30 0x7fd4600aa070 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd45400d860 tx=0x7fd454008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd4477fe700 1 -- 172.21.15.115:0/3174895807 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540125f0 con 0x7fd460068e30 2023-09-29T23:05:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd4477fe700 1 -- 172.21.15.115:0/3174895807 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd454012750 con 0x7fd460068e30 2023-09-29T23:05:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd466235700 1 -- 172.21.15.115:0/3174895807 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd460143630 con 0x7fd460068e30 2023-09-29T23:05:05.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd4477fe700 1 -- 172.21.15.115:0/3174895807 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454012af0 con 0x7fd460068e30 2023-09-29T23:05:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd466235700 1 -- 172.21.15.115:0/3174895807 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4600a30e0 con 0x7fd460068e30 2023-09-29T23:05:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.329+0000 7fd466235700 1 -- 172.21.15.115:0/3174895807 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd460070990 con 0x7fd460068e30 2023-09-29T23:05:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.333+0000 7fd4477fe700 1 -- 172.21.15.115:0/3174895807 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fd454013480 con 0x7fd460068e30 2023-09-29T23:05:05.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.333+0000 7fd4477fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:05.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.333+0000 7fd4477fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:05.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.333+0000 7fd4477fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:05.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.333+0000 7fd4477fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:05.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.333+0000 7fd4477fe700 1 --2- 172.21.15.115:0/3174895807 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd44c08e8b0 0x7fd44c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:05.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.333+0000 7fd4477fe700 1 -- 172.21.15.115:0/3174895807 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fd4540b54f0 con 0x7fd460068e30 2023-09-29T23:05:05.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.333+0000 7fd45effd700 1 --2- 172.21.15.115:0/3174895807 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd44c08e8b0 0x7fd44c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:05.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.337+0000 7fd45effd700 1 --2- 172.21.15.115:0/3174895807 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd44c08e8b0 0x7fd44c090d60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd46009fe50 tx=0x7fd450008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:05.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.337+0000 7fd4477fe700 1 -- 172.21.15.115:0/3174895807 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd454085e80 con 0x7fd460068e30 2023-09-29T23:05:05.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:05.533+0000 7fd466235700 1 -- 172.21.15.115:0/3174895807 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd4600a2b20 con 0x7fd460068e30 2023-09-29T23:05:05.937 INFO:tasks.ceph.mds.a.smithi115.stderr:2023-09-29T23:05:05.933+0000 7f2176f95700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-29T23:05:06.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.205+0000 7fd4477fe700 1 -- 172.21.15.115:0/3174895807 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd4540894a0 con 0x7fd460068e30 2023-09-29T23:05:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.209+0000 7fd466235700 10 mgrc shutdown 2023-09-29T23:05:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.209+0000 7fd466235700 1 -- 172.21.15.115:0/3174895807 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd44c08e8b0 msgr2=0x7fd44c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.209+0000 7fd466235700 1 --2- 172.21.15.115:0/3174895807 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd44c08e8b0 0x7fd44c090d60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd46009fe50 tx=0x7fd450008040 comp rx=0 tx=0).stop 2023-09-29T23:05:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.209+0000 7fd466235700 1 -- 172.21.15.115:0/3174895807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd460068e30 msgr2=0x7fd4600aa070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.209+0000 7fd466235700 1 --2- 172.21.15.115:0/3174895807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd460068e30 0x7fd4600aa070 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd45400d860 tx=0x7fd454008040 comp rx=0 tx=0).stop 2023-09-29T23:05:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.209+0000 7fd466235700 1 -- 172.21.15.115:0/3174895807 shutdown_connections 2023-09-29T23:05:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.209+0000 7fd466235700 1 --2- 172.21.15.115:0/3174895807 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd44c08e8b0 0x7fd44c090d60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.209+0000 7fd466235700 1 --2- 172.21.15.115:0/3174895807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4600a0430 0x7fd460142ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.209+0000 7fd466235700 1 --2- 172.21.15.115:0/3174895807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4600a0030 0x7fd460142760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.209+0000 7fd466235700 1 --2- 172.21.15.115:0/3174895807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd460068e30 0x7fd4600aa070 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.209+0000 7fd466235700 1 -- 172.21.15.115:0/3174895807 >> 172.21.15.115:0/3174895807 conn(0x7fd460069670 msgr2=0x7fd460140000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:06.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.209+0000 7fd466235700 1 -- 172.21.15.115:0/3174895807 shutdown_connections 2023-09-29T23:05:06.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.209+0000 7fd466235700 1 -- 172.21.15.115:0/3174895807 wait complete. 2023-09-29T23:05:06.229 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-29T23:05:06.229 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-29T23:05:06.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c33fff700 1 Processor -- start 2023-09-29T23:05:06.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c33fff700 1 -- start start 2023-09-29T23:05:06.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c33fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c340a5d60 0x7f5c340a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c33fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c340a5900 con 0x7f5c3413fbd0 2023-09-29T23:05:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c33fff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c34140180 con 0x7f5c3409c190 2023-09-29T23:05:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c33fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3409c560 con 0x7f5c340a5d60 2023-09-29T23:05:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c337fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5c3413fbd0 0x7f5c34067930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41650/0 (socket says 172.21.15.115:41650) 2023-09-29T23:05:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c327fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c340a5d60 0x7f5c340a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c337fe700 1 -- 172.21.15.115:0/3931929774 learned_addr learned my addr 172.21.15.115:0/3931929774 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c327fc700 1 -- 172.21.15.115:0/3931929774 >> v1:172.21.15.156:6789/0 conn(0x7f5c3409c190 legacy=0x7f5c3406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c327fc700 1 -- 172.21.15.115:0/3931929774 >> v1:172.21.15.115:6789/0 conn(0x7f5c3413fbd0 legacy=0x7f5c34067930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c31ffb700 1 -- 172.21.15.115:0/3931929774 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835937378 0 0) 0x7f5c1c001110 con 0x7f5c3413fbd0 2023-09-29T23:05:06.340 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c327fc700 1 -- 172.21.15.115:0/3931929774 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c34140420 con 0x7f5c340a5d60 2023-09-29T23:05:06.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c327fc700 1 --2- 172.21.15.115:0/3931929774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c340a5d60 0x7f5c340a53c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009e90 tx=0x7f5c2c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=156406d4de69502a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:06.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c31ffb700 1 -- 172.21.15.115:0/3931929774 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c00e070 con 0x7f5c340a5d60 2023-09-29T23:05:06.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c31ffb700 1 -- 172.21.15.115:0/3931929774 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c00bc30 con 0x7f5c340a5d60 2023-09-29T23:05:06.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c31ffb700 1 -- 172.21.15.115:0/3931929774 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c012430 con 0x7f5c340a5d60 2023-09-29T23:05:06.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c33fff700 1 -- 172.21.15.115:0/3931929774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c340a5d60 msgr2=0x7f5c340a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c33fff700 1 --2- 172.21.15.115:0/3931929774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c340a5d60 0x7f5c340a53c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009e90 tx=0x7f5c2c009780 comp rx=0 tx=0).stop 2023-09-29T23:05:06.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c33fff700 1 -- 172.21.15.115:0/3931929774 shutdown_connections 2023-09-29T23:05:06.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c33fff700 1 --2- 172.21.15.115:0/3931929774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c340a5d60 0x7f5c340a53c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c33fff700 1 -- 172.21.15.115:0/3931929774 >> 172.21.15.115:0/3931929774 conn(0x7f5c34068a40 msgr2=0x7f5c34068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:06.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c33fff700 1 -- 172.21.15.115:0/3931929774 shutdown_connections 2023-09-29T23:05:06.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.337+0000 7f5c33fff700 1 -- 172.21.15.115:0/3931929774 wait complete. 2023-09-29T23:05:06.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c33fff700 1 Processor -- start 2023-09-29T23:05:06.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c33fff700 1 -- start start 2023-09-29T23:05:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c33fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c3409c190 0x7f5c3413f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c33fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c340a5d60 0x7f5c3409dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c33fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c3413fbd0 0x7f5c3414d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c33fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3409d370 con 0x7f5c3413fbd0 2023-09-29T23:05:06.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c33fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3414dd80 con 0x7f5c3409c190 2023-09-29T23:05:06.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c33fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3414e020 con 0x7f5c340a5d60 2023-09-29T23:05:06.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c337fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c3413fbd0 0x7f5c3414d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c337fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c3413fbd0 0x7f5c3414d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40714/0 (socket says 172.21.15.115:40714) 2023-09-29T23:05:06.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c337fe700 1 -- 172.21.15.115:0/3571832695 learned_addr learned my addr 172.21.15.115:0/3571832695 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:06.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c327fc700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c340a5d60 0x7f5c3409dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.345 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c32ffd700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c3409c190 0x7f5c3413f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c327fc700 1 -- 172.21.15.115:0/3571832695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c3409c190 msgr2=0x7f5c3413f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c327fc700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c3409c190 0x7f5c3413f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c327fc700 1 -- 172.21.15.115:0/3571832695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c3413fbd0 msgr2=0x7f5c3414d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c327fc700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c3413fbd0 0x7f5c3414d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c327fc700 1 -- 172.21.15.115:0/3571832695 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c009a20 con 0x7f5c340a5d60 2023-09-29T23:05:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c337fe700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c3413fbd0 0x7f5c3414d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c327fc700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c340a5d60 0x7f5c3409dda0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c016000 tx=0x7f5c2c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c2affd700 1 -- 172.21.15.115:0/3571832695 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c01b420 con 0x7f5c340a5d60 2023-09-29T23:05:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c2affd700 1 -- 172.21.15.115:0/3571832695 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c01b5c0 con 0x7f5c340a5d60 2023-09-29T23:05:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c33fff700 1 -- 172.21.15.115:0/3571832695 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3409d5c0 con 0x7f5c340a5d60 2023-09-29T23:05:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.341+0000 7f5c2affd700 1 -- 172.21.15.115:0/3571832695 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c01b980 con 0x7f5c340a5d60 2023-09-29T23:05:06.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.345+0000 7f5c33fff700 1 -- 172.21.15.115:0/3571832695 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3409e5f0 con 0x7f5c340a5d60 2023-09-29T23:05:06.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.345+0000 7f5c33fff700 1 -- 172.21.15.115:0/3571832695 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3404be00 con 0x7f5c340a5d60 2023-09-29T23:05:06.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.345+0000 7f5c2affd700 1 -- 172.21.15.115:0/3571832695 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f5c2c01c400 con 0x7f5c340a5d60 2023-09-29T23:05:06.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.345+0000 7f5c2affd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:06.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.345+0000 7f5c2affd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:06.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.345+0000 7f5c2affd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:06.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.345+0000 7f5c2affd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:06.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.345+0000 7f5c2affd700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5c1408e8b0 0x7f5c14090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.345+0000 7f5c2affd700 1 -- 172.21.15.115:0/3571832695 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f5c2c0b62b0 con 0x7f5c340a5d60 2023-09-29T23:05:06.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.345+0000 7f5c32ffd700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5c1408e8b0 0x7f5c14090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.349+0000 7f5c32ffd700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5c1408e8b0 0x7f5c14090d60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5c24003a80 tx=0x7f5c24007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:06.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.353+0000 7f5c2affd700 1 -- 172.21.15.115:0/3571832695 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5c2c086d70 con 0x7f5c340a5d60 2023-09-29T23:05:06.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.549+0000 7f5c33fff700 1 -- 172.21.15.115:0/3571832695 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c3406ef20 con 0x7f5c340a5d60 2023-09-29T23:05:06.553 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.549+0000 7f5c2affd700 1 -- 172.21.15.115:0/3571832695 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3844 (secure 0 0 0) 0x7f5c2c009880 con 0x7f5c340a5d60 2023-09-29T23:05:06.553 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:06.553 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6809/3467795815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3467795815},{"type":"v1","addr":"172.21.15.115:6809","nonce":3467795815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6827/1953687175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":1953687175},{"type":"v1","addr":"172.21.15.156:6827","nonce":1953687175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-29T23:05:04.185750+0000","modified":"2023-09-29T23:05:06.199708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6811/1121307601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1121307601},{"type":"v1","addr":"172.21.15.115:6811","nonce":1121307601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-29T23:05:06.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.553+0000 7f5c33fff700 10 mgrc shutdown 2023-09-29T23:05:06.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.553+0000 7f5c33fff700 1 -- 172.21.15.115:0/3571832695 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5c1408e8b0 msgr2=0x7f5c14090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.553+0000 7f5c33fff700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5c1408e8b0 0x7f5c14090d60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5c24003a80 tx=0x7f5c24007ec0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.553+0000 7f5c33fff700 1 -- 172.21.15.115:0/3571832695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c340a5d60 msgr2=0x7f5c3409dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.553+0000 7f5c33fff700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c340a5d60 0x7f5c3409dda0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c016000 tx=0x7f5c2c019000 comp rx=0 tx=0).stop 2023-09-29T23:05:06.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.553+0000 7f5c33fff700 1 -- 172.21.15.115:0/3571832695 shutdown_connections 2023-09-29T23:05:06.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.553+0000 7f5c33fff700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5c1408e8b0 0x7f5c14090d60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.553+0000 7f5c33fff700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c3413fbd0 0x7f5c3414d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.553+0000 7f5c33fff700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5c340a5d60 0x7f5c3409dda0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.553+0000 7f5c33fff700 1 --2- 172.21.15.115:0/3571832695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c3409c190 0x7f5c3413f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.553+0000 7f5c33fff700 1 -- 172.21.15.115:0/3571832695 >> 172.21.15.115:0/3571832695 conn(0x7f5c34068a40 msgr2=0x7f5c3406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:06.556 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.553+0000 7f5c33fff700 1 -- 172.21.15.115:0/3571832695 shutdown_connections 2023-09-29T23:05:06.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.553+0000 7f5c33fff700 1 -- 172.21.15.115:0/3571832695 wait complete. 2023-09-29T23:05:06.557 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 6 2023-09-29T23:05:06.567 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:05:06.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 Processor -- start 2023-09-29T23:05:06.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 -- start start 2023-09-29T23:05:06.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b409dc30 0x7f54b409c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f54b409d470 0x7f54b413ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b406a940 con 0x7f54b4069c90 2023-09-29T23:05:06.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b409ea40 con 0x7f54b409d470 2023-09-29T23:05:06.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b406a060 con 0x7f54b409dc30 2023-09-29T23:05:06.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b409dc30 0x7f54b409c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b94df700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f54b409d470 0x7f54b413ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b94df700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f54b409d470 0x7f54b413ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40726/0 (socket says 172.21.15.115:40726) 2023-09-29T23:05:06.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b409dc30 0x7f54b409c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33082/0 (socket says 172.21.15.115:33082) 2023-09-29T23:05:06.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b94df700 1 -- 172.21.15.115:0/761740330 learned_addr learned my addr 172.21.15.115:0/761740330 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:06.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b94df700 1 -- 172.21.15.115:0/761740330 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b409dc30 msgr2=0x7f54b409c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:06.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b94df700 1 --2- 172.21.15.115:0/761740330 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b409dc30 0x7f54b409c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b94df700 1 -- 172.21.15.115:0/761740330 >> v1:172.21.15.156:6789/0 conn(0x7f54b4069c90 legacy=0x7f54b409e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b94df700 1 -- 172.21.15.115:0/761740330 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b409ec50 con 0x7f54b409d470 2023-09-29T23:05:06.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b94df700 1 --2- 172.21.15.115:0/761740330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b409d470 0x7f54b413ca40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009f20 tx=0x7f54ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49a1f23127eaf8f server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:06.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b37fe700 1 -- 172.21.15.115:0/761740330 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0092e0 con 0x7f54b409d470 2023-09-29T23:05:06.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b37fe700 1 -- 172.21.15.115:0/761740330 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac00b9d0 con 0x7f54b409d470 2023-09-29T23:05:06.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b37fe700 1 -- 172.21.15.115:0/761740330 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00bd90 con 0x7f54b409d470 2023-09-29T23:05:06.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 -- 172.21.15.115:0/761740330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b409d470 msgr2=0x7f54b413ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 --2- 172.21.15.115:0/761740330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b409d470 0x7f54b413ca40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009f20 tx=0x7f54ac009840 comp rx=0 tx=0).stop 2023-09-29T23:05:06.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 -- 172.21.15.115:0/761740330 shutdown_connections 2023-09-29T23:05:06.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 --2- 172.21.15.115:0/761740330 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b409d470 0x7f54b413ca40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 --2- 172.21.15.115:0/761740330 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b409dc30 0x7f54b409c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 -- 172.21.15.115:0/761740330 >> 172.21.15.115:0/761740330 conn(0x7f54b40a2a60 msgr2=0x7f54b40a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:06.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 -- 172.21.15.115:0/761740330 shutdown_connections 2023-09-29T23:05:06.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.669+0000 7f54b9ce0700 1 -- 172.21.15.115:0/761740330 wait complete. 2023-09-29T23:05:06.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.673+0000 7f54b9ce0700 1 Processor -- start 2023-09-29T23:05:06.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.673+0000 7f54b9ce0700 1 -- start start 2023-09-29T23:05:06.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.673+0000 7f54b9ce0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b4069c90 0x7f54b409f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.673+0000 7f54b9ce0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b409d470 0x7f54b4142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.673+0000 7f54b9ce0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b409dc30 0x7f54b406e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.673+0000 7f54b9ce0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b406e290 con 0x7f54b409dc30 2023-09-29T23:05:06.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.673+0000 7f54b9ce0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40a0630 con 0x7f54b409d470 2023-09-29T23:05:06.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.673+0000 7f54b9ce0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b409f9e0 con 0x7f54b4069c90 2023-09-29T23:05:06.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.673+0000 7f54b8cde700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b4069c90 0x7f54b409f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.673+0000 7f54b94df700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b409dc30 0x7f54b406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.673+0000 7f54b8cde700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b4069c90 0x7f54b409f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33090/0 (socket says 172.21.15.115:33090) 2023-09-29T23:05:06.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.673+0000 7f54b8cde700 1 -- 172.21.15.115:0/2077454831 learned_addr learned my addr 172.21.15.115:0/2077454831 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:06.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.673+0000 7f54b3fff700 1 --2- 172.21.15.115:0/2077454831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b409d470 0x7f54b4142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.678 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.677+0000 7f54b8cde700 1 -- 172.21.15.115:0/2077454831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b409d470 msgr2=0x7f54b4142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.677+0000 7f54b8cde700 1 --2- 172.21.15.115:0/2077454831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b409d470 0x7f54b4142500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.677+0000 7f54b8cde700 1 -- 172.21.15.115:0/2077454831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b409dc30 msgr2=0x7f54b406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.677+0000 7f54b8cde700 1 --2- 172.21.15.115:0/2077454831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b409dc30 0x7f54b406e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.677+0000 7f54b8cde700 1 -- 172.21.15.115:0/2077454831 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac009ae0 con 0x7f54b4069c90 2023-09-29T23:05:06.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.677+0000 7f54b8cde700 1 --2- 172.21.15.115:0/2077454831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b4069c90 0x7f54b409f3b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f54a400c790 tx=0x7f54a4007f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:06.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.677+0000 7f54b0ff9700 1 -- 172.21.15.115:0/2077454831 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4011590 con 0x7f54b4069c90 2023-09-29T23:05:06.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.677+0000 7f54b0ff9700 1 -- 172.21.15.115:0/2077454831 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a40116f0 con 0x7f54b4069c90 2023-09-29T23:05:06.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.677+0000 7f54b9ce0700 1 -- 172.21.15.115:0/2077454831 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b409fca0 con 0x7f54b4069c90 2023-09-29T23:05:06.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.677+0000 7f54b0ff9700 1 -- 172.21.15.115:0/2077454831 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4011ab0 con 0x7f54b4069c90 2023-09-29T23:05:06.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.677+0000 7f54b9ce0700 1 -- 172.21.15.115:0/2077454831 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b406d630 con 0x7f54b4069c90 2023-09-29T23:05:06.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.677+0000 7f54b9ce0700 1 -- 172.21.15.115:0/2077454831 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b404be00 con 0x7f54b4069c90 2023-09-29T23:05:06.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.681+0000 7f54b0ff9700 1 -- 172.21.15.115:0/2077454831 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f54a401b3b0 con 0x7f54b4069c90 2023-09-29T23:05:06.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.681+0000 7f54b0ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:06.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.681+0000 7f54b0ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:06.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.681+0000 7f54b0ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:06.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.681+0000 7f54b0ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:06.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.681+0000 7f54b0ff9700 1 --2- 172.21.15.115:0/2077454831 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f54a008e8b0 0x7f54a0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.681+0000 7f54b0ff9700 1 -- 172.21.15.115:0/2077454831 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f54a40b3a20 con 0x7f54b4069c90 2023-09-29T23:05:06.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.681+0000 7f54b3fff700 1 --2- 172.21.15.115:0/2077454831 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f54a008e8b0 0x7f54a0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.681+0000 7f54b3fff700 1 --2- 172.21.15.115:0/2077454831 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f54a008e8b0 0x7f54a0090d60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54b40b3610 tx=0x7f54a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:06.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.685+0000 7f54b0ff9700 1 -- 172.21.15.115:0/2077454831 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f54a40844e0 con 0x7f54b4069c90 2023-09-29T23:05:06.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.845+0000 7f54b9ce0700 1 -- 172.21.15.115:0/2077454831 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54b406a940 con 0x7f54b4069c90 2023-09-29T23:05:06.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.845+0000 7f54b0ff9700 1 -- 172.21.15.115:0/2077454831 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12206 (secure 0 0 0) 0x7f54b406a940 con 0x7f54b4069c90 2023-09-29T23:05:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:06.848 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":20,"fsid":"593687ae-01c7-4a32-a91e-931db75fb751","created":"2023-09-29T23:04:48.574873+0000","modified":"2023-09-29T23:05:05.189678+0000","last_up_change":"2023-09-29T23:04:53.614158+0000","last_in_change":"2023-09-29T23:04:50.489116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-29T23:04:54.900033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-29T23:04:58.342574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-29T23:05:02.595115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-29T23:05:03.183110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9da0e8c9-ea18-4691-87ef-fbf5502845a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":26662},{"type":"v1","addr":"172.21.15.115:6801","nonce":26662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":26662},{"type":"v1","addr":"172.21.15.115:6803","nonce":26662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":26662},{"type":"v1","addr":"172.21.15.115:6807","nonce":26662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":26662},{"type":"v1","addr":"172.21.15.115:6805","nonce":26662}]},"public_addr":"172.21.15.115:6801/26662","cluster_addr":"172.21.15.115:6803/26662","heartbeat_back_addr":"172.21.15.115:6807/26662","heartbeat_front_addr":"172.21.15.115:6805/26662","state":["exists","up"]},{"osd":1,"uuid":"eaaa380c-73da-4075-992d-ab16b36d8ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":26874},{"type":"v1","addr":"172.21.15.156:6801","nonce":26874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":26874},{"type":"v1","addr":"172.21.15.156:6803","nonce":26874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":26874},{"type":"v1","addr":"172.21.15.156:6807","nonce":26874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":26874},{"type":"v1","addr":"172.21.15.156:6805","nonce":26874}]},"public_addr":"172.21.15.156:6801/26874","cluster_addr":"172.21.15.156:6803/26874","heartbeat_back_addr":"172.21.15.156:6807/26874","heartbeat_front_addr":"172.21.15.156:6805/26874","state":["exists","up"]},{"osd":2,"uuid":"01e8286e-30af-41c7-bcd1-c4545f9f0a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":26873},{"type":"v1","addr":"172.21.15.156:6809","nonce":26873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":26873},{"type":"v1","addr":"172.21.15.156:6811","nonce":26873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":26873},{"type":"v1","addr":"172.21.15.156:6817","nonce":26873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":26873},{"type":"v1","addr":"172.21.15.156:6813","nonce":26873}]},"public_addr":"172.21.15.156:6809/26873","cluster_addr":"172.21.15.156:6811/26873","heartbeat_back_addr":"172.21.15.156:6817/26873","heartbeat_front_addr":"172.21.15.156:6813/26873","state":["exists","up"]},{"osd":3,"uuid":"4f6a1234-5ac6-43b0-baaa-3567ab7c73a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6815","nonce":26875},{"type":"v1","addr":"172.21.15.156:6816","nonce":26875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":26875},{"type":"v1","addr":"172.21.15.156:6819","nonce":26875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":26875},{"type":"v1","addr":"172.21.15.156:6823","nonce":26875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":26875},{"type":"v1","addr":"172.21.15.156:6821","nonce":26875}]},"public_addr":"172.21.15.156:6816/26875","cluster_addr":"172.21.15.156:6819/26875","heartbeat_back_addr":"172.21.15.156:6823/26875","heartbeat_front_addr":"172.21.15.156:6821/26875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.582513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.686413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:05:06.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.849+0000 7f54b9ce0700 10 mgrc shutdown 2023-09-29T23:05:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.849+0000 7f54b9ce0700 1 -- 172.21.15.115:0/2077454831 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f54a008e8b0 msgr2=0x7f54a0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.849+0000 7f54b9ce0700 1 --2- 172.21.15.115:0/2077454831 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f54a008e8b0 0x7f54a0090d60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54b40b3610 tx=0x7f54a8008040 comp rx=0 tx=0).stop 2023-09-29T23:05:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.849+0000 7f54b9ce0700 1 -- 172.21.15.115:0/2077454831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b4069c90 msgr2=0x7f54b409f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.849+0000 7f54b9ce0700 1 --2- 172.21.15.115:0/2077454831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b4069c90 0x7f54b409f3b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f54a400c790 tx=0x7f54a4007f40 comp rx=0 tx=0).stop 2023-09-29T23:05:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.849+0000 7f54b9ce0700 1 -- 172.21.15.115:0/2077454831 shutdown_connections 2023-09-29T23:05:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.849+0000 7f54b9ce0700 1 --2- 172.21.15.115:0/2077454831 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f54a008e8b0 0x7f54a0090d60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.849+0000 7f54b9ce0700 1 --2- 172.21.15.115:0/2077454831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54b409dc30 0x7f54b406e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.849+0000 7f54b9ce0700 1 --2- 172.21.15.115:0/2077454831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54b409d470 0x7f54b4142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.849+0000 7f54b9ce0700 1 --2- 172.21.15.115:0/2077454831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54b4069c90 0x7f54b409f3b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.849+0000 7f54b9ce0700 1 -- 172.21.15.115:0/2077454831 >> 172.21.15.115:0/2077454831 conn(0x7f54b40a2a60 msgr2=0x7f54b4137c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:06.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.849+0000 7f54b9ce0700 1 -- 172.21.15.115:0/2077454831 shutdown_connections 2023-09-29T23:05:06.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.849+0000 7f54b9ce0700 1 -- 172.21.15.115:0/2077454831 wait complete. 2023-09-29T23:05:06.868 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-29T23:05:06.868 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:05:06.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.969+0000 7f43d17b6700 1 Processor -- start 2023-09-29T23:05:06.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.969+0000 7f43d17b6700 1 -- start start 2023-09-29T23:05:06.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.969+0000 7f43d17b6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f43cc06c190 0x7f43cc0a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.969+0000 7f43d17b6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43cc0a5010 con 0x7f43cc06bdc0 2023-09-29T23:05:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.969+0000 7f43d17b6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43cc140590 con 0x7f43cc0a4b30 2023-09-29T23:05:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.969+0000 7f43d17b6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43cc140850 con 0x7f43cc06c190 2023-09-29T23:05:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.969+0000 7f43caffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f43cc06bdc0 0x7f43cc13fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41656/0 (socket says 172.21.15.115:41656) 2023-09-29T23:05:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.969+0000 7f43caffd700 1 -- 172.21.15.115:0/3546369734 learned_addr learned my addr 172.21.15.115:0/3546369734 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.969+0000 7f43ca7fc700 1 --2- 172.21.15.115:0/3546369734 >> v2:172.21.15.115:3300/0 conn(0x7f43cc06c190 0x7f43cc0a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521451343 0 0) 0x7f43cc0a5010 con 0x7f43cc06bdc0 2023-09-29T23:05:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b4003570 con 0x7f43cc06bdc0 2023-09-29T23:05:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049116705 0 0) 0x7f43cc140590 con 0x7f43cc0a4b30 2023-09-29T23:05:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43cc0a5010 con 0x7f43cc0a4b30 2023-09-29T23:05:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 423816691 0 0) 0x7f43b4003570 con 0x7f43cc06bdc0 2023-09-29T23:05:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 >> v2:172.21.15.115:3300/0 conn(0x7f43cc06c190 msgr2=0x7f43cc0a65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:06.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 --2- 172.21.15.115:0/3546369734 >> v2:172.21.15.115:3300/0 conn(0x7f43cc06c190 0x7f43cc0a65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 >> v1:172.21.15.156:6789/0 conn(0x7f43cc0a4b30 legacy=0x7f43cc069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc140b10 con 0x7f43cc06bdc0 2023-09-29T23:05:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3987234196 0 0) 0x7f43bc001470 con 0x7f43cc06bdc0 2023-09-29T23:05:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 >> v1:172.21.15.115:6789/0 conn(0x7f43cc06bdc0 legacy=0x7f43cc13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 --2- 172.21.15.115:0/3546369734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b4003bf0 0x7f43b4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 --2- 172.21.15.115:0/3546369734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43b4004810 0x7f43b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 --2- 172.21.15.115:0/3546369734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43b40051c0 0x7f43b400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc140850 con 0x7f43b4003bf0 2023-09-29T23:05:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b400c160 con 0x7f43b4004810 2023-09-29T23:05:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b400c320 con 0x7f43b40051c0 2023-09-29T23:05:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43caffd700 1 --2- 172.21.15.115:0/3546369734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b4003bf0 0x7f43b4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43ca7fc700 1 --2- 172.21.15.115:0/3546369734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43b4004810 0x7f43b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43cb7fe700 1 --2- 172.21.15.115:0/3546369734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43b40051c0 0x7f43b400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43caffd700 1 -- 172.21.15.115:0/3546369734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43b40051c0 msgr2=0x7f43b400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:06.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43caffd700 1 --2- 172.21.15.115:0/3546369734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43b40051c0 0x7f43b400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43caffd700 1 -- 172.21.15.115:0/3546369734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43b4004810 msgr2=0x7f43b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:06.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43caffd700 1 --2- 172.21.15.115:0/3546369734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43b4004810 0x7f43b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43caffd700 1 -- 172.21.15.115:0/3546369734 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b4003570 con 0x7f43b4003bf0 2023-09-29T23:05:06.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43cb7fe700 1 -- 172.21.15.115:0/3546369734 reap_dead start 2023-09-29T23:05:06.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43caffd700 1 --2- 172.21.15.115:0/3546369734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b4003bf0 0x7f43b4003fe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00c2a0 tx=0x7f43bc001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c4e3c9977a9cbc server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:06.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc00cb30 con 0x7f43b4003bf0 2023-09-29T23:05:06.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc00ccb0 con 0x7f43b4003bf0 2023-09-29T23:05:06.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43c9ffb700 1 -- 172.21.15.115:0/3546369734 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc005b70 con 0x7f43b4003bf0 2023-09-29T23:05:06.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43d17b6700 1 -- 172.21.15.115:0/3546369734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b4003bf0 msgr2=0x7f43b4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43d17b6700 1 --2- 172.21.15.115:0/3546369734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b4003bf0 0x7f43b4003fe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00c2a0 tx=0x7f43bc001e10 comp rx=0 tx=0).stop 2023-09-29T23:05:06.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43d17b6700 1 -- 172.21.15.115:0/3546369734 shutdown_connections 2023-09-29T23:05:06.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43d17b6700 1 --2- 172.21.15.115:0/3546369734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b4003bf0 0x7f43b4003fe0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43d17b6700 1 -- 172.21.15.115:0/3546369734 >> 172.21.15.115:0/3546369734 conn(0x7f43cc0b4bc0 msgr2=0x7f43cc06b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:06.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43d17b6700 1 -- 172.21.15.115:0/3546369734 shutdown_connections 2023-09-29T23:05:06.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.973+0000 7f43d17b6700 1 -- 172.21.15.115:0/3546369734 wait complete. 2023-09-29T23:05:06.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43d17b6700 1 Processor -- start 2023-09-29T23:05:06.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43d17b6700 1 -- start start 2023-09-29T23:05:06.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43d17b6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43b4003bf0 0x7f43cc143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43d17b6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43cc141f60 0x7f43cc14f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43d17b6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43cc1431f0 0x7f43cc09ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43d17b6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc142350 con 0x7f43cc1431f0 2023-09-29T23:05:06.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43d17b6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc14f970 con 0x7f43cc141f60 2023-09-29T23:05:06.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43d17b6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc14fbd0 con 0x7f43b4003bf0 2023-09-29T23:05:06.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43caffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43b4003bf0 0x7f43cc143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43caffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43b4003bf0 0x7f43cc143e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33106/0 (socket says 172.21.15.115:33106) 2023-09-29T23:05:06.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43caffd700 1 -- 172.21.15.115:0/938325175 learned_addr learned my addr 172.21.15.115:0/938325175 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:06.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43cb7fe700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43cc1431f0 0x7f43cc09ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43ca7fc700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43cc141f60 0x7f43cc14f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43caffd700 1 -- 172.21.15.115:0/938325175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43cc141f60 msgr2=0x7f43cc14f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43caffd700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43cc141f60 0x7f43cc14f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43caffd700 1 -- 172.21.15.115:0/938325175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43cc1431f0 msgr2=0x7f43cc09ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:06.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43caffd700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43cc1431f0 0x7f43cc09ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:06.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43caffd700 1 -- 172.21.15.115:0/938325175 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc14fe90 con 0x7f43b4003bf0 2023-09-29T23:05:06.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.977+0000 7f43caffd700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43b4003bf0 0x7f43cc143e10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f43bc011000 tx=0x7f43bc015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:06.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.981+0000 7f43b2ffd700 1 -- 172.21.15.115:0/938325175 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc001b30 con 0x7f43b4003bf0 2023-09-29T23:05:06.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.981+0000 7f43b2ffd700 1 -- 172.21.15.115:0/938325175 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc004c10 con 0x7f43b4003bf0 2023-09-29T23:05:06.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.981+0000 7f43d17b6700 1 -- 172.21.15.115:0/938325175 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc09fe70 con 0x7f43b4003bf0 2023-09-29T23:05:06.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.981+0000 7f43b2ffd700 1 -- 172.21.15.115:0/938325175 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0070d0 con 0x7f43b4003bf0 2023-09-29T23:05:06.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.981+0000 7f43d17b6700 1 -- 172.21.15.115:0/938325175 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc1438b0 con 0x7f43b4003bf0 2023-09-29T23:05:06.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.981+0000 7f43d17b6700 1 -- 172.21.15.115:0/938325175 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc070990 con 0x7f43b4003bf0 2023-09-29T23:05:06.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.985+0000 7f43b2ffd700 1 -- 172.21.15.115:0/938325175 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f43bc007480 con 0x7f43b4003bf0 2023-09-29T23:05:06.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.985+0000 7f43b2ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:06.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.985+0000 7f43b2ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:06.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.985+0000 7f43b2ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:06.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.985+0000 7f43b2ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:06.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.985+0000 7f43b2ffd700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f43b808e8b0 0x7f43b8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:06.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.985+0000 7f43b2ffd700 1 -- 172.21.15.115:0/938325175 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f43bc0b5900 con 0x7f43b4003bf0 2023-09-29T23:05:06.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.985+0000 7f43ca7fc700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f43b808e8b0 0x7f43b8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:06.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.985+0000 7f43ca7fc700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f43b808e8b0 0x7f43b8090d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f43c0006eb0 tx=0x7f43c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:06.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:06.989+0000 7f43b2ffd700 1 -- 172.21.15.115:0/938325175 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f43bc086320 con 0x7f43b4003bf0 2023-09-29T23:05:07.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.149+0000 7f43d17b6700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-29T23:05:07.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.149+0000 7f43d17b6700 1 -- 172.21.15.115:0/938325175 --> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43cc09fc50 con 0x7f43b808e8b0 2023-09-29T23:05:07.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.165+0000 7f43b2ffd700 1 -- 172.21.15.115:0/938325175 <== mgr.4107 v2:172.21.15.156:6824/26644 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263179 (secure 0 0 0) 0x7f43cc09fc50 con 0x7f43b808e8b0 2023-09-29T23:05:07.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.165+0000 7f43b2ffd700 20 mgrc handle_command_reply tid 0 r 0 2023-09-29T23:05:07.171 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:07.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.169+0000 7f43d17b6700 10 mgrc shutdown 2023-09-29T23:05:07.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.169+0000 7f43d17b6700 1 -- 172.21.15.115:0/938325175 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f43b808e8b0 msgr2=0x7f43b8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.169+0000 7f43d17b6700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f43b808e8b0 0x7f43b8090d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f43c0006eb0 tx=0x7f43c0008040 comp rx=0 tx=0).stop 2023-09-29T23:05:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.169+0000 7f43d17b6700 1 -- 172.21.15.115:0/938325175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43b4003bf0 msgr2=0x7f43cc143e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.169+0000 7f43d17b6700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43b4003bf0 0x7f43cc143e10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f43bc011000 tx=0x7f43bc015000 comp rx=0 tx=0).stop 2023-09-29T23:05:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.169+0000 7f43d17b6700 1 -- 172.21.15.115:0/938325175 shutdown_connections 2023-09-29T23:05:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.169+0000 7f43d17b6700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f43b808e8b0 0x7f43b8090d60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.169+0000 7f43d17b6700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43cc1431f0 0x7f43cc09ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.169+0000 7f43d17b6700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43cc141f60 0x7f43cc14f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.169+0000 7f43d17b6700 1 --2- 172.21.15.115:0/938325175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f43b4003bf0 0x7f43cc143e10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.169+0000 7f43d17b6700 1 -- 172.21.15.115:0/938325175 >> 172.21.15.115:0/938325175 conn(0x7f43cc0b4bc0 msgr2=0x7f43cc068cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:07.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.173+0000 7f43d17b6700 1 -- 172.21.15.115:0/938325175 shutdown_connections 2023-09-29T23:05:07.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.173+0000 7f43d17b6700 1 -- 172.21.15.115:0/938325175 wait complete. 2023-09-29T23:05:07.175 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-09-29T23:05:07.188 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-09-29T23:05:06.838917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":374797520,"kb_used":3186128,"kb_used_data":371611712,"kb_used_omap":411,"kb_used_meta":0,"kb_avail":371611392,"statfs":{"total":383792660480,"available":380530065408,"internally_reserved":327680,"allocated":380530393088,"data_stored":380530393088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":421004,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":38,"commit_latency_ns":0,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.016922"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.847662+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:08.282524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851614+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:02:45.413482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851733+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:00:59.236159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.855729+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:18:29.699338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848212+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:32.935665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849677+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:36:15.669365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.855865+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:44:09.433237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850208+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:12:54.806149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845935+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:23:08.165955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854400+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:18.681401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852032+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:31:53.623960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845938+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:45:19.820523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845307+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:43:42.473330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850142+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:27:03.221776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850370+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:04:36.437126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849281+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:17.918744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854525+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:03.578342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850342+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:27:58.793491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846337+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:07:57.307417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854802+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:33:35.631951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846830+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:50:45.952748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854277+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:02:48.471581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.853990+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:08:59.954277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848560+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:42:07.158440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.853767+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:33:00.710798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852737+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:46:23.962799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851165+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:28.548035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.853518+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:29:45.889254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848629+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:53.841175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850688+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:34:48.714874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851975+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:44:09.407881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846528+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:03:01.571565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852969+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:51:24.073380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.860892+0000","last_change":"2023-09-29T23:05:03.861608+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.860892+0000","last_undegraded":"2023-09-29T23:05:03.860892+0000","last_fullsized":"2023-09-29T23:05:03.860892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850896+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:42:01.814209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.840810+0000","last_change":"2023-09-29T23:05:03.841192+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.840810+0000","last_undegraded":"2023-09-29T23:05:03.840810+0000","last_fullsized":"2023-09-29T23:05:03.840810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.855304+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:46:44.253356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.841828+0000","last_change":"2023-09-29T23:05:03.842249+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.841828+0000","last_undegraded":"2023-09-29T23:05:03.841828+0000","last_fullsized":"2023-09-29T23:05:03.841828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:27:57.781735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849989+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:38.742119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.849842+0000","last_change":"2023-09-29T23:05:03.849842+0000","last_active":"2023-09-29T23:05:03.849842+0000","last_peered":"2023-09-29T23:05:03.849842+0000","last_clean":"2023-09-29T23:05:03.849842+0000","last_became_active":"2023-09-29T23:05:03.849529+0000","last_became_peered":"2023-09-29T23:05:03.849529+0000","last_unstale":"2023-09-29T23:05:03.849842+0000","last_undegraded":"2023-09-29T23:05:03.849842+0000","last_fullsized":"2023-09-29T23:05:03.849842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.853590+0000","last_change":"2023-09-29T23:05:03.853590+0000","last_active":"2023-09-29T23:05:03.853590+0000","last_peered":"2023-09-29T23:05:03.853590+0000","last_clean":"2023-09-29T23:05:03.853590+0000","last_became_active":"2023-09-29T23:05:03.853335+0000","last_became_peered":"2023-09-29T23:05:03.853335+0000","last_unstale":"2023-09-29T23:05:03.853590+0000","last_undegraded":"2023-09-29T23:05:03.853590+0000","last_fullsized":"2023-09-29T23:05:03.853590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:57:20.234700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851633+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:22:14.141803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.853815+0000","last_change":"2023-09-29T23:05:03.853815+0000","last_active":"2023-09-29T23:05:03.853815+0000","last_peered":"2023-09-29T23:05:03.853815+0000","last_clean":"2023-09-29T23:05:03.853815+0000","last_became_active":"2023-09-29T23:05:03.853456+0000","last_became_peered":"2023-09-29T23:05:03.853456+0000","last_unstale":"2023-09-29T23:05:03.853815+0000","last_undegraded":"2023-09-29T23:05:03.853815+0000","last_fullsized":"2023-09-29T23:05:03.853815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848355+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:28:39.908387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.844642+0000","last_change":"2023-09-29T23:05:03.846600+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.844642+0000","last_undegraded":"2023-09-29T23:05:03.844642+0000","last_fullsized":"2023-09-29T23:05:03.844642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:37.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848753+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:57:25.282750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.844114+0000","last_change":"2023-09-29T23:05:03.844675+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.844114+0000","last_undegraded":"2023-09-29T23:05:03.844114+0000","last_fullsized":"2023-09-29T23:05:03.844114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:52.829419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.843763+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:41:32.696950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.879324+0000","last_change":"2023-09-29T23:05:03.879324+0000","last_active":"2023-09-29T23:05:03.879324+0000","last_peered":"2023-09-29T23:05:03.879324+0000","last_clean":"2023-09-29T23:05:03.879324+0000","last_became_active":"2023-09-29T23:05:03.874684+0000","last_became_peered":"2023-09-29T23:05:03.874684+0000","last_unstale":"2023-09-29T23:05:03.879324+0000","last_undegraded":"2023-09-29T23:05:03.879324+0000","last_fullsized":"2023-09-29T23:05:03.879324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:07:10.402882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851535+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:08:19.473130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.851543+0000","last_change":"2023-09-29T23:05:03.851543+0000","last_active":"2023-09-29T23:05:03.851543+0000","last_peered":"2023-09-29T23:05:03.851543+0000","last_clean":"2023-09-29T23:05:03.851543+0000","last_became_active":"2023-09-29T23:05:03.849728+0000","last_became_peered":"2023-09-29T23:05:03.849728+0000","last_unstale":"2023-09-29T23:05:03.851543+0000","last_undegraded":"2023-09-29T23:05:03.851543+0000","last_fullsized":"2023-09-29T23:05:03.851543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850615+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:08:43.654146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.873312+0000","last_change":"2023-09-29T23:05:03.873312+0000","last_active":"2023-09-29T23:05:03.873312+0000","last_peered":"2023-09-29T23:05:03.873312+0000","last_clean":"2023-09-29T23:05:03.873312+0000","last_became_active":"2023-09-29T23:05:03.867491+0000","last_became_peered":"2023-09-29T23:05:03.867491+0000","last_unstale":"2023-09-29T23:05:03.873312+0000","last_undegraded":"2023-09-29T23:05:03.873312+0000","last_fullsized":"2023-09-29T23:05:03.873312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:21:38.208894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.843629+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:25.767254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.878136+0000","last_change":"2023-09-29T23:05:03.878136+0000","last_active":"2023-09-29T23:05:03.878136+0000","last_peered":"2023-09-29T23:05:03.878136+0000","last_clean":"2023-09-29T23:05:03.878136+0000","last_became_active":"2023-09-29T23:05:03.872575+0000","last_became_peered":"2023-09-29T23:05:03.872575+0000","last_unstale":"2023-09-29T23:05:03.878136+0000","last_undegraded":"2023-09-29T23:05:03.878136+0000","last_fullsized":"2023-09-29T23:05:03.878136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:18:45.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849714+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:47:02.919688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822229+0000","last_change":"2023-09-29T23:04:56.664338+0000","last_active":"2023-09-29T23:05:02.822229+0000","last_peered":"2023-09-29T23:05:02.822229+0000","last_clean":"2023-09-29T23:05:02.822229+0000","last_became_active":"2023-09-29T23:04:56.663441+0000","last_became_peered":"2023-09-29T23:04:56.663441+0000","last_unstale":"2023-09-29T23:05:02.822229+0000","last_undegraded":"2023-09-29T23:05:02.822229+0000","last_fullsized":"2023-09-29T23:05:02.822229+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_clean_scrub_stamp":"2023-09-29T23:04:55.640704+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:54:28.112724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.825047+0000","last_change":"2023-09-29T23:04:59.797078+0000","last_active":"2023-09-29T23:05:02.825047+0000","last_peered":"2023-09-29T23:05:02.825047+0000","last_clean":"2023-09-29T23:05:02.825047+0000","last_became_active":"2023-09-29T23:04:59.795998+0000","last_became_peered":"2023-09-29T23:04:59.795998+0000","last_unstale":"2023-09-29T23:05:02.825047+0000","last_undegraded":"2023-09-29T23:05:02.825047+0000","last_fullsized":"2023-09-29T23:05:02.825047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.861050+0000","last_change":"2023-09-29T23:05:03.861201+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.861050+0000","last_undegraded":"2023-09-29T23:05:03.861050+0000","last_fullsized":"2023-09-29T23:05:03.861050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:56:45.933376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849867+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:11:05.030356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822981+0000","last_change":"2023-09-29T23:04:59.798054+0000","last_active":"2023-09-29T23:05:02.822981+0000","last_peered":"2023-09-29T23:05:02.822981+0000","last_clean":"2023-09-29T23:05:02.822981+0000","last_became_active":"2023-09-29T23:04:59.797489+0000","last_became_peered":"2023-09-29T23:04:59.797489+0000","last_unstale":"2023-09-29T23:05:02.822981+0000","last_undegraded":"2023-09-29T23:05:02.822981+0000","last_fullsized":"2023-09-29T23:05:02.822981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:32:42.777486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.851676+0000","last_change":"2023-09-29T23:05:03.851676+0000","last_active":"2023-09-29T23:05:03.851676+0000","last_peered":"2023-09-29T23:05:03.851676+0000","last_clean":"2023-09-29T23:05:03.851676+0000","last_became_active":"2023-09-29T23:05:03.851368+0000","last_became_peered":"2023-09-29T23:05:03.851368+0000","last_unstale":"2023-09-29T23:05:03.851676+0000","last_undegraded":"2023-09-29T23:05:03.851676+0000","last_fullsized":"2023-09-29T23:05:03.851676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:43:41.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854744+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:50:01.256063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.823215+0000","last_change":"2023-09-29T23:04:59.951828+0000","last_active":"2023-09-29T23:05:02.823215+0000","last_peered":"2023-09-29T23:05:02.823215+0000","last_clean":"2023-09-29T23:05:02.823215+0000","last_became_active":"2023-09-29T23:04:59.951181+0000","last_became_peered":"2023-09-29T23:04:59.951181+0000","last_unstale":"2023-09-29T23:05:02.823215+0000","last_undegraded":"2023-09-29T23:05:02.823215+0000","last_fullsized":"2023-09-29T23:05:02.823215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.847255+0000","last_change":"2023-09-29T23:05:03.847255+0000","last_active":"2023-09-29T23:05:03.847255+0000","last_peered":"2023-09-29T23:05:03.847255+0000","last_clean":"2023-09-29T23:05:03.847255+0000","last_became_active":"2023-09-29T23:05:03.846967+0000","last_became_peered":"2023-09-29T23:05:03.846967+0000","last_unstale":"2023-09-29T23:05:03.847255+0000","last_undegraded":"2023-09-29T23:05:03.847255+0000","last_fullsized":"2023-09-29T23:05:03.847255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:41:31.685195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848434+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:44:09.433237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.825640+0000","last_change":"2023-09-29T23:04:59.797795+0000","last_active":"2023-09-29T23:05:02.825640+0000","last_peered":"2023-09-29T23:05:02.825640+0000","last_clean":"2023-09-29T23:05:02.825640+0000","last_became_active":"2023-09-29T23:04:59.796512+0000","last_became_peered":"2023-09-29T23:04:59.796512+0000","last_unstale":"2023-09-29T23:05:02.825640+0000","last_undegraded":"2023-09-29T23:05:02.825640+0000","last_fullsized":"2023-09-29T23:05:02.825640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.848672+0000","last_change":"2023-09-29T23:05:03.848672+0000","last_active":"2023-09-29T23:05:03.848672+0000","last_peered":"2023-09-29T23:05:03.848672+0000","last_clean":"2023-09-29T23:05:03.848672+0000","last_became_active":"2023-09-29T23:05:03.848507+0000","last_became_peered":"2023-09-29T23:05:03.848507+0000","last_unstale":"2023-09-29T23:05:03.848672+0000","last_undegraded":"2023-09-29T23:05:03.848672+0000","last_fullsized":"2023-09-29T23:05:03.848672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:19:37.297844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848355+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:46:40.708391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.844413+0000","last_change":"2023-09-29T23:05:03.845055+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.844413+0000","last_undegraded":"2023-09-29T23:05:03.844413+0000","last_fullsized":"2023-09-29T23:05:03.844413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:28:17.915992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822652+0000","last_change":"2023-09-29T23:04:59.952454+0000","last_active":"2023-09-29T23:05:02.822652+0000","last_peered":"2023-09-29T23:05:02.822652+0000","last_clean":"2023-09-29T23:05:02.822652+0000","last_became_active":"2023-09-29T23:04:59.951496+0000","last_became_peered":"2023-09-29T23:04:59.951496+0000","last_unstale":"2023-09-29T23:05:02.822652+0000","last_undegraded":"2023-09-29T23:05:02.822652+0000","last_fullsized":"2023-09-29T23:05:02.822652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.847097+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:50:01.256063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.855922+0000","last_change":"2023-09-29T23:05:03.855922+0000","last_active":"2023-09-29T23:05:03.855922+0000","last_peered":"2023-09-29T23:05:03.855922+0000","last_clean":"2023-09-29T23:05:03.855922+0000","last_became_active":"2023-09-29T23:05:03.851814+0000","last_became_peered":"2023-09-29T23:05:03.851814+0000","last_unstale":"2023-09-29T23:05:03.855922+0000","last_undegraded":"2023-09-29T23:05:03.855922+0000","last_fullsized":"2023-09-29T23:05:03.855922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:29:31.409379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.826355+0000","last_change":"2023-09-29T23:04:59.798170+0000","last_active":"2023-09-29T23:05:02.826355+0000","last_peered":"2023-09-29T23:05:02.826355+0000","last_clean":"2023-09-29T23:05:02.826355+0000","last_became_active":"2023-09-29T23:04:59.797758+0000","last_became_peered":"2023-09-29T23:04:59.797758+0000","last_unstale":"2023-09-29T23:05:02.826355+0000","last_undegraded":"2023-09-29T23:05:02.826355+0000","last_fullsized":"2023-09-29T23:05:02.826355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:23.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845914+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:32:47.567597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":7,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.879328+0000","last_change":"2023-09-29T23:05:03.879418+0000","last_active":"2023-09-29T23:05:03.879328+0000","last_peered":"2023-09-29T23:05:03.879328+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"2023-09-29T23:05:03.875943+0000","last_became_peered":"2023-09-29T23:05:03.875943+0000","last_unstale":"2023-09-29T23:05:03.879328+0000","last_undegraded":"2023-09-29T23:05:03.879328+0000","last_fullsized":"2023-09-29T23:05:03.879328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:22:16.497716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822477+0000","last_change":"2023-09-29T23:04:59.794782+0000","last_active":"2023-09-29T23:05:02.822477+0000","last_peered":"2023-09-29T23:05:02.822477+0000","last_clean":"2023-09-29T23:05:02.822477+0000","last_became_active":"2023-09-29T23:04:59.794073+0000","last_became_peered":"2023-09-29T23:04:59.794073+0000","last_unstale":"2023-09-29T23:05:02.822477+0000","last_undegraded":"2023-09-29T23:05:02.822477+0000","last_fullsized":"2023-09-29T23:05:02.822477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:44:24.462680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846593+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:47.915370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.851188+0000","last_change":"2023-09-29T23:05:03.851188+0000","last_active":"2023-09-29T23:05:03.851188+0000","last_peered":"2023-09-29T23:05:03.851188+0000","last_clean":"2023-09-29T23:05:03.851188+0000","last_became_active":"2023-09-29T23:05:03.850904+0000","last_became_peered":"2023-09-29T23:05:03.850904+0000","last_unstale":"2023-09-29T23:05:03.851188+0000","last_undegraded":"2023-09-29T23:05:03.851188+0000","last_fullsized":"2023-09-29T23:05:03.851188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:24.755498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.826148+0000","last_change":"2023-09-29T23:04:59.799021+0000","last_active":"2023-09-29T23:05:02.826148+0000","last_peered":"2023-09-29T23:05:02.826148+0000","last_clean":"2023-09-29T23:05:02.826148+0000","last_became_active":"2023-09-29T23:04:59.797145+0000","last_became_peered":"2023-09-29T23:04:59.797145+0000","last_unstale":"2023-09-29T23:05:02.826148+0000","last_undegraded":"2023-09-29T23:05:02.826148+0000","last_fullsized":"2023-09-29T23:05:02.826148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:46:55.987895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.843218+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:15:37.246780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.844309+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:22:17.509472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.853192+0000","last_change":"2023-09-29T23:05:03.853192+0000","last_active":"2023-09-29T23:05:03.853192+0000","last_peered":"2023-09-29T23:05:03.853192+0000","last_clean":"2023-09-29T23:05:03.853192+0000","last_became_active":"2023-09-29T23:05:03.852382+0000","last_became_peered":"2023-09-29T23:05:03.852382+0000","last_unstale":"2023-09-29T23:05:03.853192+0000","last_undegraded":"2023-09-29T23:05:03.853192+0000","last_fullsized":"2023-09-29T23:05:03.853192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:49:53.513521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849855+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:46:44.253356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":7,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.859461+0000","last_change":"2023-09-29T23:05:03.859535+0000","last_active":"2023-09-29T23:05:03.859461+0000","last_peered":"2023-09-29T23:05:03.859461+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"2023-09-29T23:05:03.858960+0000","last_became_peered":"2023-09-29T23:05:03.858960+0000","last_unstale":"2023-09-29T23:05:03.859461+0000","last_undegraded":"2023-09-29T23:05:03.859461+0000","last_fullsized":"2023-09-29T23:05:03.859461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.857165+0000","last_change":"2023-09-29T23:05:03.857165+0000","last_active":"2023-09-29T23:05:03.857165+0000","last_peered":"2023-09-29T23:05:03.857165+0000","last_clean":"2023-09-29T23:05:03.857165+0000","last_became_active":"2023-09-29T23:05:03.856861+0000","last_became_peered":"2023-09-29T23:05:03.856861+0000","last_unstale":"2023-09-29T23:05:03.857165+0000","last_undegraded":"2023-09-29T23:05:03.857165+0000","last_fullsized":"2023-09-29T23:05:03.857165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:36:14.657609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849733+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:28:18.927748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.856407+0000","last_change":"2023-09-29T23:05:03.856407+0000","last_active":"2023-09-29T23:05:03.856407+0000","last_peered":"2023-09-29T23:05:03.856407+0000","last_clean":"2023-09-29T23:05:03.856407+0000","last_became_active":"2023-09-29T23:05:03.855984+0000","last_became_peered":"2023-09-29T23:05:03.855984+0000","last_unstale":"2023-09-29T23:05:03.856407+0000","last_undegraded":"2023-09-29T23:05:03.856407+0000","last_fullsized":"2023-09-29T23:05:03.856407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:46:25.574473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852141+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:32:47.567597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846381+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:13.653906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":5,"reported_epoch":18,"state":"active","last_fresh":"2023-09-29T23:05:03.880964+0000","last_change":"2023-09-29T23:05:03.880964+0000","last_active":"2023-09-29T23:05:03.880964+0000","last_peered":"2023-09-29T23:05:03.880964+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"2023-09-29T23:05:03.880964+0000","last_became_peered":"2023-09-29T23:05:03.880964+0000","last_unstale":"2023-09-29T23:05:03.880964+0000","last_undegraded":"2023-09-29T23:05:03.880964+0000","last_fullsized":"2023-09-29T23:05:03.880964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:15:36.235024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849143+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:56.707907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.835998+0000","last_change":"2023-09-29T23:05:03.836362+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.835998+0000","last_undegraded":"2023-09-29T23:05:03.835998+0000","last_fullsized":"2023-09-29T23:05:03.835998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851924+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:14:55.197436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.857474+0000","last_change":"2023-09-29T23:05:03.857474+0000","last_active":"2023-09-29T23:05:03.857474+0000","last_peered":"2023-09-29T23:05:03.857474+0000","last_clean":"2023-09-29T23:05:03.857474+0000","last_became_active":"2023-09-29T23:05:03.857167+0000","last_became_peered":"2023-09-29T23:05:03.857167+0000","last_unstale":"2023-09-29T23:05:03.857474+0000","last_undegraded":"2023-09-29T23:05:03.857474+0000","last_fullsized":"2023-09-29T23:05:03.857474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:31.923909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845001+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:29:32.421135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.860723+0000","last_change":"2023-09-29T23:05:03.861113+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.860723+0000","last_undegraded":"2023-09-29T23:05:03.860723+0000","last_fullsized":"2023-09-29T23:05:03.860723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.844867+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:52:36.204606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.836312+0000","last_change":"2023-09-29T23:05:03.836671+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.836312+0000","last_undegraded":"2023-09-29T23:05:03.836312+0000","last_fullsized":"2023-09-29T23:05:03.836312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849156+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:03:27.134395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.852972+0000","last_change":"2023-09-29T23:05:03.852972+0000","last_active":"2023-09-29T23:05:03.852972+0000","last_peered":"2023-09-29T23:05:03.852972+0000","last_clean":"2023-09-29T23:05:03.852972+0000","last_became_active":"2023-09-29T23:05:03.852482+0000","last_became_peered":"2023-09-29T23:05:03.852482+0000","last_unstale":"2023-09-29T23:05:03.852972+0000","last_undegraded":"2023-09-29T23:05:03.852972+0000","last_fullsized":"2023-09-29T23:05:03.852972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:00.205324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848712+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:01.217080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.865954+0000","last_change":"2023-09-29T23:05:03.865954+0000","last_active":"2023-09-29T23:05:03.865954+0000","last_peered":"2023-09-29T23:05:03.865954+0000","last_clean":"2023-09-29T23:05:03.865954+0000","last_became_active":"2023-09-29T23:05:03.862839+0000","last_became_peered":"2023-09-29T23:05:03.862839+0000","last_unstale":"2023-09-29T23:05:03.865954+0000","last_undegraded":"2023-09-29T23:05:03.865954+0000","last_fullsized":"2023-09-29T23:05:03.865954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:51:59.213175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.842196+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:07:06.833043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.850861+0000","last_change":"2023-09-29T23:05:03.850861+0000","last_active":"2023-09-29T23:05:03.850861+0000","last_peered":"2023-09-29T23:05:03.850861+0000","last_clean":"2023-09-29T23:05:03.850861+0000","last_became_active":"2023-09-29T23:05:03.848098+0000","last_became_peered":"2023-09-29T23:05:03.848098+0000","last_unstale":"2023-09-29T23:05:03.850861+0000","last_undegraded":"2023-09-29T23:05:03.850861+0000","last_fullsized":"2023-09-29T23:05:03.850861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795932,"kb_used_data":92903536,"kb_used_omap":62,"kb_used_meta":0,"kb_avail":92903448,"statfs":{"total":95948165120,"available":95133130752,"internally_reserved":90112,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63692,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":13,"commit_latency_ns":0,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797092,"kb_used_data":92902320,"kb_used_omap":124,"kb_used_meta":0,"kb_avail":92902288,"statfs":{"total":95948165120,"available":95131942912,"internally_reserved":32768,"allocated":95131975680,"data_stored":95131975680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":127133,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797140,"kb_used_data":92902320,"kb_used_omap":139,"kb_used_meta":0,"kb_avail":92902240,"statfs":{"total":95948165120,"available":95131893760,"internally_reserved":81920,"allocated":95131975680,"data_stored":95131975680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":142784,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":3,"commit_latency_ns":0,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795964,"kb_used_data":92903536,"kb_used_omap":85,"kb_used_meta":0,"kb_avail":92903416,"statfs":{"total":95948165120,"available":95133097984,"internally_reserved":122880,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87395,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":18,"commit_latency_ns":0,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]}],"pool_statfs":[]}} 2023-09-29T23:05:07.194 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:05:07.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fc205a700 1 Processor -- start 2023-09-29T23:05:07.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fc205a700 1 -- start start 2023-09-29T23:05:07.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fc205a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6fbc13d700 0x7f6fbc140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fc205a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fbc13e770 con 0x7f6fbc09d9e0 2023-09-29T23:05:07.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fc205a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fbc13dc00 con 0x7f6fbc09ddb0 2023-09-29T23:05:07.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fc205a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fbc141d20 con 0x7f6fbc13d700 2023-09-29T23:05:07.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fc1058700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6fbc09d9e0 0x7f6fbc141610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41658/0 (socket says 172.21.15.115:41658) 2023-09-29T23:05:07.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fc1058700 1 -- 172.21.15.115:0/2340803417 learned_addr learned my addr 172.21.15.115:0/2340803417 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:07.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fc1859700 1 --2- 172.21.15.115:0/2340803417 >> v2:172.21.15.156:3300/0 conn(0x7f6fbc13d700 0x7f6fbc140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263739387 0 0) 0x7f6fbc13e770 con 0x7f6fbc09d9e0 2023-09-29T23:05:07.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa8003570 con 0x7f6fbc09d9e0 2023-09-29T23:05:07.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3106807480 0 0) 0x7f6fa8003570 con 0x7f6fbc09d9e0 2023-09-29T23:05:07.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 >> v2:172.21.15.156:3300/0 conn(0x7f6fbc13d700 msgr2=0x7f6fbc140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:07.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 --2- 172.21.15.115:0/2340803417 >> v2:172.21.15.156:3300/0 conn(0x7f6fbc13d700 0x7f6fbc140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 >> v1:172.21.15.156:6789/0 conn(0x7f6fbc09ddb0 legacy=0x7f6fbc0a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc13dec0 con 0x7f6fbc09d9e0 2023-09-29T23:05:07.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3987234196 0 0) 0x7f6fac001470 con 0x7f6fbc09d9e0 2023-09-29T23:05:07.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 >> v1:172.21.15.115:6789/0 conn(0x7f6fbc09d9e0 legacy=0x7f6fbc141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 --2- 172.21.15.115:0/2340803417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fa8003a60 0x7f6fa8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 --2- 172.21.15.115:0/2340803417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fa8004810 0x7f6fa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 --2- 172.21.15.115:0/2340803417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa80051c0 0x7f6fa800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc141d20 con 0x7f6fa8004810 2023-09-29T23:05:07.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa800c0d0 con 0x7f6fa80051c0 2023-09-29T23:05:07.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.297+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa800c290 con 0x7f6fa8003a60 2023-09-29T23:05:07.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc0857700 1 --2- 172.21.15.115:0/2340803417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fa8004810 0x7f6fa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc1058700 1 --2- 172.21.15.115:0/2340803417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fa8003a60 0x7f6fa8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc1859700 1 --2- 172.21.15.115:0/2340803417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa80051c0 0x7f6fa800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc0857700 1 -- 172.21.15.115:0/2340803417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fa8003a60 msgr2=0x7f6fa8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:07.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc0857700 1 --2- 172.21.15.115:0/2340803417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fa8003a60 0x7f6fa8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc0857700 1 -- 172.21.15.115:0/2340803417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa80051c0 msgr2=0x7f6fa800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:07.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc0857700 1 --2- 172.21.15.115:0/2340803417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa80051c0 0x7f6fa800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc0857700 1 -- 172.21.15.115:0/2340803417 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa8003570 con 0x7f6fa8004810 2023-09-29T23:05:07.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc1859700 1 --2- 172.21.15.115:0/2340803417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fa80051c0 0x7f6fa800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:07.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc1859700 1 -- 172.21.15.115:0/2340803417 reap_dead start 2023-09-29T23:05:07.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc0857700 1 --2- 172.21.15.115:0/2340803417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fa8004810 0x7f6fa8004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80018b0 tx=0x7f6fb8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b02d395a117fd41 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:07.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8012420 con 0x7f6fa8004810 2023-09-29T23:05:07.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb80125a0 con 0x7f6fa8004810 2023-09-29T23:05:07.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fb3fff700 1 -- 172.21.15.115:0/2340803417 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8012960 con 0x7f6fa8004810 2023-09-29T23:05:07.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc205a700 1 -- 172.21.15.115:0/2340803417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fa8004810 msgr2=0x7f6fa8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc205a700 1 --2- 172.21.15.115:0/2340803417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fa8004810 0x7f6fa8004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80018b0 tx=0x7f6fb8007d30 comp rx=0 tx=0).stop 2023-09-29T23:05:07.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc205a700 1 -- 172.21.15.115:0/2340803417 shutdown_connections 2023-09-29T23:05:07.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc205a700 1 --2- 172.21.15.115:0/2340803417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fa8004810 0x7f6fa8004c80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc205a700 1 -- 172.21.15.115:0/2340803417 >> 172.21.15.115:0/2340803417 conn(0x7f6fbc0b1d20 msgr2=0x7f6fbc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:07.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc205a700 1 -- 172.21.15.115:0/2340803417 shutdown_connections 2023-09-29T23:05:07.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc205a700 1 -- 172.21.15.115:0/2340803417 wait complete. 2023-09-29T23:05:07.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc205a700 1 Processor -- start 2023-09-29T23:05:07.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.301+0000 7f6fc205a700 1 -- start start 2023-09-29T23:05:07.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc205a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fa8004810 0x7f6fbc0a5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc205a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fbc06e850 0x7f6fbc14f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc205a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fbc14fea0 0x7f6fbc09b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc205a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc0a5ea0 con 0x7f6fbc06e850 2023-09-29T23:05:07.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc205a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc150460 con 0x7f6fbc14fea0 2023-09-29T23:05:07.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc205a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc150720 con 0x7f6fa8004810 2023-09-29T23:05:07.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc1058700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fa8004810 0x7f6fbc0a5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc0857700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fbc06e850 0x7f6fbc14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc1058700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fa8004810 0x7f6fbc0a5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33120/0 (socket says 172.21.15.115:33120) 2023-09-29T23:05:07.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc1058700 1 -- 172.21.15.115:0/161272652 learned_addr learned my addr 172.21.15.115:0/161272652 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:07.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc1859700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fbc14fea0 0x7f6fbc09b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc1058700 1 -- 172.21.15.115:0/161272652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fbc14fea0 msgr2=0x7f6fbc09b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc1058700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fbc14fea0 0x7f6fbc09b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc1058700 1 -- 172.21.15.115:0/161272652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fbc06e850 msgr2=0x7f6fbc14f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc1058700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fbc06e850 0x7f6fbc14f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc1058700 1 -- 172.21.15.115:0/161272652 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc06ec20 con 0x7f6fa8004810 2023-09-29T23:05:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc0857700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fbc06e850 0x7f6fbc14f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc1058700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fa8004810 0x7f6fbc0a5630 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0073c0 tx=0x7f6fac001e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fb17fa700 1 -- 172.21.15.115:0/161272652 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac018030 con 0x7f6fa8004810 2023-09-29T23:05:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fb17fa700 1 -- 172.21.15.115:0/161272652 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac00f8e0 con 0x7f6fa8004810 2023-09-29T23:05:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc205a700 1 -- 172.21.15.115:0/161272652 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fbc150aa0 con 0x7f6fa8004810 2023-09-29T23:05:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fb17fa700 1 -- 172.21.15.115:0/161272652 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00fca0 con 0x7f6fa8004810 2023-09-29T23:05:07.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc205a700 1 -- 172.21.15.115:0/161272652 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fbc06f1d0 con 0x7f6fa8004810 2023-09-29T23:05:07.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.305+0000 7f6fc205a700 1 -- 172.21.15.115:0/161272652 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fbc04be00 con 0x7f6fa8004810 2023-09-29T23:05:07.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.309+0000 7f6fb17fa700 1 -- 172.21.15.115:0/161272652 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f6fac01b070 con 0x7f6fa8004810 2023-09-29T23:05:07.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.309+0000 7f6fb17fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:07.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.309+0000 7f6fb17fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:07.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.309+0000 7f6fb17fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:07.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.309+0000 7f6fb17fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:07.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.309+0000 7f6fb17fa700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6fa008e860 0x7f6fa0090d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.309+0000 7f6fb17fa700 1 -- 172.21.15.115:0/161272652 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f6fac019070 con 0x7f6fa8004810 2023-09-29T23:05:07.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.309+0000 7f6fc0857700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6fa008e860 0x7f6fa0090d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.313+0000 7f6fc0857700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6fa008e860 0x7f6fa0090d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0af6a0 tx=0x7f6fb8015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.317+0000 7f6fb17fa700 1 -- 172.21.15.115:0/161272652 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6fac0851c0 con 0x7f6fa8004810 2023-09-29T23:05:07.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.477+0000 7f6fc205a700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-29T23:05:07.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.477+0000 7f6fc205a700 1 -- 172.21.15.115:0/161272652 --> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fbc140db0 con 0x7f6fa008e860 2023-09-29T23:05:07.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.493+0000 7f6fb17fa700 1 -- 172.21.15.115:0/161272652 <== mgr.4107 v2:172.21.15.156:6824/26644 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263179 (secure 0 0 0) 0x7f6fbc140db0 con 0x7f6fa008e860 2023-09-29T23:05:07.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.493+0000 7f6fb17fa700 20 mgrc handle_command_reply tid 0 r 0 2023-09-29T23:05:07.499 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:07.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.497+0000 7f6fc205a700 10 mgrc shutdown 2023-09-29T23:05:07.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.497+0000 7f6fc205a700 1 -- 172.21.15.115:0/161272652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6fa008e860 msgr2=0x7f6fa0090d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.497+0000 7f6fc205a700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6fa008e860 0x7f6fa0090d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0af6a0 tx=0x7f6fb8015000 comp rx=0 tx=0).stop 2023-09-29T23:05:07.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.497+0000 7f6fc205a700 1 -- 172.21.15.115:0/161272652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fa8004810 msgr2=0x7f6fbc0a5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.497+0000 7f6fc205a700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fa8004810 0x7f6fbc0a5630 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0073c0 tx=0x7f6fac001e50 comp rx=0 tx=0).stop 2023-09-29T23:05:07.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.497+0000 7f6fc205a700 1 -- 172.21.15.115:0/161272652 shutdown_connections 2023-09-29T23:05:07.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.497+0000 7f6fc205a700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fbc14fea0 0x7f6fbc09b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.497+0000 7f6fc205a700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6fa008e860 0x7f6fa0090d10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.497+0000 7f6fc205a700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fbc06e850 0x7f6fbc14f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.497+0000 7f6fc205a700 1 --2- 172.21.15.115:0/161272652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6fa8004810 0x7f6fbc0a5630 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.497+0000 7f6fc205a700 1 -- 172.21.15.115:0/161272652 >> 172.21.15.115:0/161272652 conn(0x7f6fbc0b1d20 msgr2=0x7f6fbc069260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:07.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.497+0000 7f6fc205a700 1 -- 172.21.15.115:0/161272652 shutdown_connections 2023-09-29T23:05:07.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.497+0000 7f6fc205a700 1 -- 172.21.15.115:0/161272652 wait complete. 2023-09-29T23:05:07.503 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-09-29T23:05:07.517 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-09-29T23:05:06.838917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":374797520,"kb_used":3186128,"kb_used_data":371611712,"kb_used_omap":411,"kb_used_meta":0,"kb_avail":371611392,"statfs":{"total":383792660480,"available":380530065408,"internally_reserved":327680,"allocated":380530393088,"data_stored":380530393088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":421004,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":38,"commit_latency_ns":0,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.016922"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.847662+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:08.282524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851614+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:02:45.413482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851733+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:00:59.236159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.855729+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:18:29.699338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848212+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:32.935665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849677+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:36:15.669365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.855865+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:44:09.433237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850208+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:12:54.806149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845935+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:23:08.165955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854400+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:18.681401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852032+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:31:53.623960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845938+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:45:19.820523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845307+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:43:42.473330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850142+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:27:03.221776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850370+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:04:36.437126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849281+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:17.918744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854525+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:03.578342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850342+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:27:58.793491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846337+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:07:57.307417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854802+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:33:35.631951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846830+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:50:45.952748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854277+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:02:48.471581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.853990+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:08:59.954277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848560+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:42:07.158440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.853767+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:33:00.710798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852737+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:46:23.962799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851165+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:28.548035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.853518+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:29:45.889254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848629+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:53.841175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850688+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:34:48.714874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851975+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:44:09.407881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846528+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:03:01.571565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852969+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:51:24.073380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.860892+0000","last_change":"2023-09-29T23:05:03.861608+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.860892+0000","last_undegraded":"2023-09-29T23:05:03.860892+0000","last_fullsized":"2023-09-29T23:05:03.860892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850896+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:42:01.814209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.840810+0000","last_change":"2023-09-29T23:05:03.841192+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.840810+0000","last_undegraded":"2023-09-29T23:05:03.840810+0000","last_fullsized":"2023-09-29T23:05:03.840810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.855304+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:46:44.253356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.841828+0000","last_change":"2023-09-29T23:05:03.842249+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.841828+0000","last_undegraded":"2023-09-29T23:05:03.841828+0000","last_fullsized":"2023-09-29T23:05:03.841828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:27:57.781735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849989+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:38.742119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.849842+0000","last_change":"2023-09-29T23:05:03.849842+0000","last_active":"2023-09-29T23:05:03.849842+0000","last_peered":"2023-09-29T23:05:03.849842+0000","last_clean":"2023-09-29T23:05:03.849842+0000","last_became_active":"2023-09-29T23:05:03.849529+0000","last_became_peered":"2023-09-29T23:05:03.849529+0000","last_unstale":"2023-09-29T23:05:03.849842+0000","last_undegraded":"2023-09-29T23:05:03.849842+0000","last_fullsized":"2023-09-29T23:05:03.849842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.853590+0000","last_change":"2023-09-29T23:05:03.853590+0000","last_active":"2023-09-29T23:05:03.853590+0000","last_peered":"2023-09-29T23:05:03.853590+0000","last_clean":"2023-09-29T23:05:03.853590+0000","last_became_active":"2023-09-29T23:05:03.853335+0000","last_became_peered":"2023-09-29T23:05:03.853335+0000","last_unstale":"2023-09-29T23:05:03.853590+0000","last_undegraded":"2023-09-29T23:05:03.853590+0000","last_fullsized":"2023-09-29T23:05:03.853590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:57:20.234700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851633+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:22:14.141803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.853815+0000","last_change":"2023-09-29T23:05:03.853815+0000","last_active":"2023-09-29T23:05:03.853815+0000","last_peered":"2023-09-29T23:05:03.853815+0000","last_clean":"2023-09-29T23:05:03.853815+0000","last_became_active":"2023-09-29T23:05:03.853456+0000","last_became_peered":"2023-09-29T23:05:03.853456+0000","last_unstale":"2023-09-29T23:05:03.853815+0000","last_undegraded":"2023-09-29T23:05:03.853815+0000","last_fullsized":"2023-09-29T23:05:03.853815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848355+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:28:39.908387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.844642+0000","last_change":"2023-09-29T23:05:03.846600+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.844642+0000","last_undegraded":"2023-09-29T23:05:03.844642+0000","last_fullsized":"2023-09-29T23:05:03.844642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:37.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848753+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:57:25.282750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.844114+0000","last_change":"2023-09-29T23:05:03.844675+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.844114+0000","last_undegraded":"2023-09-29T23:05:03.844114+0000","last_fullsized":"2023-09-29T23:05:03.844114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:52.829419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.843763+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:41:32.696950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.879324+0000","last_change":"2023-09-29T23:05:03.879324+0000","last_active":"2023-09-29T23:05:03.879324+0000","last_peered":"2023-09-29T23:05:03.879324+0000","last_clean":"2023-09-29T23:05:03.879324+0000","last_became_active":"2023-09-29T23:05:03.874684+0000","last_became_peered":"2023-09-29T23:05:03.874684+0000","last_unstale":"2023-09-29T23:05:03.879324+0000","last_undegraded":"2023-09-29T23:05:03.879324+0000","last_fullsized":"2023-09-29T23:05:03.879324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:07:10.402882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851535+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:08:19.473130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.851543+0000","last_change":"2023-09-29T23:05:03.851543+0000","last_active":"2023-09-29T23:05:03.851543+0000","last_peered":"2023-09-29T23:05:03.851543+0000","last_clean":"2023-09-29T23:05:03.851543+0000","last_became_active":"2023-09-29T23:05:03.849728+0000","last_became_peered":"2023-09-29T23:05:03.849728+0000","last_unstale":"2023-09-29T23:05:03.851543+0000","last_undegraded":"2023-09-29T23:05:03.851543+0000","last_fullsized":"2023-09-29T23:05:03.851543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850615+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:08:43.654146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.873312+0000","last_change":"2023-09-29T23:05:03.873312+0000","last_active":"2023-09-29T23:05:03.873312+0000","last_peered":"2023-09-29T23:05:03.873312+0000","last_clean":"2023-09-29T23:05:03.873312+0000","last_became_active":"2023-09-29T23:05:03.867491+0000","last_became_peered":"2023-09-29T23:05:03.867491+0000","last_unstale":"2023-09-29T23:05:03.873312+0000","last_undegraded":"2023-09-29T23:05:03.873312+0000","last_fullsized":"2023-09-29T23:05:03.873312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:21:38.208894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.843629+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:25.767254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.878136+0000","last_change":"2023-09-29T23:05:03.878136+0000","last_active":"2023-09-29T23:05:03.878136+0000","last_peered":"2023-09-29T23:05:03.878136+0000","last_clean":"2023-09-29T23:05:03.878136+0000","last_became_active":"2023-09-29T23:05:03.872575+0000","last_became_peered":"2023-09-29T23:05:03.872575+0000","last_unstale":"2023-09-29T23:05:03.878136+0000","last_undegraded":"2023-09-29T23:05:03.878136+0000","last_fullsized":"2023-09-29T23:05:03.878136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:18:45.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849714+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:47:02.919688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822229+0000","last_change":"2023-09-29T23:04:56.664338+0000","last_active":"2023-09-29T23:05:02.822229+0000","last_peered":"2023-09-29T23:05:02.822229+0000","last_clean":"2023-09-29T23:05:02.822229+0000","last_became_active":"2023-09-29T23:04:56.663441+0000","last_became_peered":"2023-09-29T23:04:56.663441+0000","last_unstale":"2023-09-29T23:05:02.822229+0000","last_undegraded":"2023-09-29T23:05:02.822229+0000","last_fullsized":"2023-09-29T23:05:02.822229+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_clean_scrub_stamp":"2023-09-29T23:04:55.640704+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:54:28.112724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.825047+0000","last_change":"2023-09-29T23:04:59.797078+0000","last_active":"2023-09-29T23:05:02.825047+0000","last_peered":"2023-09-29T23:05:02.825047+0000","last_clean":"2023-09-29T23:05:02.825047+0000","last_became_active":"2023-09-29T23:04:59.795998+0000","last_became_peered":"2023-09-29T23:04:59.795998+0000","last_unstale":"2023-09-29T23:05:02.825047+0000","last_undegraded":"2023-09-29T23:05:02.825047+0000","last_fullsized":"2023-09-29T23:05:02.825047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.861050+0000","last_change":"2023-09-29T23:05:03.861201+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.861050+0000","last_undegraded":"2023-09-29T23:05:03.861050+0000","last_fullsized":"2023-09-29T23:05:03.861050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:56:45.933376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849867+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:11:05.030356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822981+0000","last_change":"2023-09-29T23:04:59.798054+0000","last_active":"2023-09-29T23:05:02.822981+0000","last_peered":"2023-09-29T23:05:02.822981+0000","last_clean":"2023-09-29T23:05:02.822981+0000","last_became_active":"2023-09-29T23:04:59.797489+0000","last_became_peered":"2023-09-29T23:04:59.797489+0000","last_unstale":"2023-09-29T23:05:02.822981+0000","last_undegraded":"2023-09-29T23:05:02.822981+0000","last_fullsized":"2023-09-29T23:05:02.822981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:32:42.777486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.851676+0000","last_change":"2023-09-29T23:05:03.851676+0000","last_active":"2023-09-29T23:05:03.851676+0000","last_peered":"2023-09-29T23:05:03.851676+0000","last_clean":"2023-09-29T23:05:03.851676+0000","last_became_active":"2023-09-29T23:05:03.851368+0000","last_became_peered":"2023-09-29T23:05:03.851368+0000","last_unstale":"2023-09-29T23:05:03.851676+0000","last_undegraded":"2023-09-29T23:05:03.851676+0000","last_fullsized":"2023-09-29T23:05:03.851676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:43:41.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854744+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:50:01.256063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.823215+0000","last_change":"2023-09-29T23:04:59.951828+0000","last_active":"2023-09-29T23:05:02.823215+0000","last_peered":"2023-09-29T23:05:02.823215+0000","last_clean":"2023-09-29T23:05:02.823215+0000","last_became_active":"2023-09-29T23:04:59.951181+0000","last_became_peered":"2023-09-29T23:04:59.951181+0000","last_unstale":"2023-09-29T23:05:02.823215+0000","last_undegraded":"2023-09-29T23:05:02.823215+0000","last_fullsized":"2023-09-29T23:05:02.823215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.847255+0000","last_change":"2023-09-29T23:05:03.847255+0000","last_active":"2023-09-29T23:05:03.847255+0000","last_peered":"2023-09-29T23:05:03.847255+0000","last_clean":"2023-09-29T23:05:03.847255+0000","last_became_active":"2023-09-29T23:05:03.846967+0000","last_became_peered":"2023-09-29T23:05:03.846967+0000","last_unstale":"2023-09-29T23:05:03.847255+0000","last_undegraded":"2023-09-29T23:05:03.847255+0000","last_fullsized":"2023-09-29T23:05:03.847255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:41:31.685195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848434+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:44:09.433237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.825640+0000","last_change":"2023-09-29T23:04:59.797795+0000","last_active":"2023-09-29T23:05:02.825640+0000","last_peered":"2023-09-29T23:05:02.825640+0000","last_clean":"2023-09-29T23:05:02.825640+0000","last_became_active":"2023-09-29T23:04:59.796512+0000","last_became_peered":"2023-09-29T23:04:59.796512+0000","last_unstale":"2023-09-29T23:05:02.825640+0000","last_undegraded":"2023-09-29T23:05:02.825640+0000","last_fullsized":"2023-09-29T23:05:02.825640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.848672+0000","last_change":"2023-09-29T23:05:03.848672+0000","last_active":"2023-09-29T23:05:03.848672+0000","last_peered":"2023-09-29T23:05:03.848672+0000","last_clean":"2023-09-29T23:05:03.848672+0000","last_became_active":"2023-09-29T23:05:03.848507+0000","last_became_peered":"2023-09-29T23:05:03.848507+0000","last_unstale":"2023-09-29T23:05:03.848672+0000","last_undegraded":"2023-09-29T23:05:03.848672+0000","last_fullsized":"2023-09-29T23:05:03.848672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:19:37.297844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848355+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:46:40.708391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.844413+0000","last_change":"2023-09-29T23:05:03.845055+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.844413+0000","last_undegraded":"2023-09-29T23:05:03.844413+0000","last_fullsized":"2023-09-29T23:05:03.844413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:28:17.915992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822652+0000","last_change":"2023-09-29T23:04:59.952454+0000","last_active":"2023-09-29T23:05:02.822652+0000","last_peered":"2023-09-29T23:05:02.822652+0000","last_clean":"2023-09-29T23:05:02.822652+0000","last_became_active":"2023-09-29T23:04:59.951496+0000","last_became_peered":"2023-09-29T23:04:59.951496+0000","last_unstale":"2023-09-29T23:05:02.822652+0000","last_undegraded":"2023-09-29T23:05:02.822652+0000","last_fullsized":"2023-09-29T23:05:02.822652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.847097+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:50:01.256063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.855922+0000","last_change":"2023-09-29T23:05:03.855922+0000","last_active":"2023-09-29T23:05:03.855922+0000","last_peered":"2023-09-29T23:05:03.855922+0000","last_clean":"2023-09-29T23:05:03.855922+0000","last_became_active":"2023-09-29T23:05:03.851814+0000","last_became_peered":"2023-09-29T23:05:03.851814+0000","last_unstale":"2023-09-29T23:05:03.855922+0000","last_undegraded":"2023-09-29T23:05:03.855922+0000","last_fullsized":"2023-09-29T23:05:03.855922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:29:31.409379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.826355+0000","last_change":"2023-09-29T23:04:59.798170+0000","last_active":"2023-09-29T23:05:02.826355+0000","last_peered":"2023-09-29T23:05:02.826355+0000","last_clean":"2023-09-29T23:05:02.826355+0000","last_became_active":"2023-09-29T23:04:59.797758+0000","last_became_peered":"2023-09-29T23:04:59.797758+0000","last_unstale":"2023-09-29T23:05:02.826355+0000","last_undegraded":"2023-09-29T23:05:02.826355+0000","last_fullsized":"2023-09-29T23:05:02.826355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:23.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845914+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:32:47.567597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":7,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.879328+0000","last_change":"2023-09-29T23:05:03.879418+0000","last_active":"2023-09-29T23:05:03.879328+0000","last_peered":"2023-09-29T23:05:03.879328+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"2023-09-29T23:05:03.875943+0000","last_became_peered":"2023-09-29T23:05:03.875943+0000","last_unstale":"2023-09-29T23:05:03.879328+0000","last_undegraded":"2023-09-29T23:05:03.879328+0000","last_fullsized":"2023-09-29T23:05:03.879328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:22:16.497716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822477+0000","last_change":"2023-09-29T23:04:59.794782+0000","last_active":"2023-09-29T23:05:02.822477+0000","last_peered":"2023-09-29T23:05:02.822477+0000","last_clean":"2023-09-29T23:05:02.822477+0000","last_became_active":"2023-09-29T23:04:59.794073+0000","last_became_peered":"2023-09-29T23:04:59.794073+0000","last_unstale":"2023-09-29T23:05:02.822477+0000","last_undegraded":"2023-09-29T23:05:02.822477+0000","last_fullsized":"2023-09-29T23:05:02.822477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:44:24.462680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846593+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:47.915370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.851188+0000","last_change":"2023-09-29T23:05:03.851188+0000","last_active":"2023-09-29T23:05:03.851188+0000","last_peered":"2023-09-29T23:05:03.851188+0000","last_clean":"2023-09-29T23:05:03.851188+0000","last_became_active":"2023-09-29T23:05:03.850904+0000","last_became_peered":"2023-09-29T23:05:03.850904+0000","last_unstale":"2023-09-29T23:05:03.851188+0000","last_undegraded":"2023-09-29T23:05:03.851188+0000","last_fullsized":"2023-09-29T23:05:03.851188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:24.755498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.826148+0000","last_change":"2023-09-29T23:04:59.799021+0000","last_active":"2023-09-29T23:05:02.826148+0000","last_peered":"2023-09-29T23:05:02.826148+0000","last_clean":"2023-09-29T23:05:02.826148+0000","last_became_active":"2023-09-29T23:04:59.797145+0000","last_became_peered":"2023-09-29T23:04:59.797145+0000","last_unstale":"2023-09-29T23:05:02.826148+0000","last_undegraded":"2023-09-29T23:05:02.826148+0000","last_fullsized":"2023-09-29T23:05:02.826148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:46:55.987895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.843218+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:15:37.246780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.844309+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:22:17.509472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.853192+0000","last_change":"2023-09-29T23:05:03.853192+0000","last_active":"2023-09-29T23:05:03.853192+0000","last_peered":"2023-09-29T23:05:03.853192+0000","last_clean":"2023-09-29T23:05:03.853192+0000","last_became_active":"2023-09-29T23:05:03.852382+0000","last_became_peered":"2023-09-29T23:05:03.852382+0000","last_unstale":"2023-09-29T23:05:03.853192+0000","last_undegraded":"2023-09-29T23:05:03.853192+0000","last_fullsized":"2023-09-29T23:05:03.853192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:49:53.513521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849855+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:46:44.253356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":7,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.859461+0000","last_change":"2023-09-29T23:05:03.859535+0000","last_active":"2023-09-29T23:05:03.859461+0000","last_peered":"2023-09-29T23:05:03.859461+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"2023-09-29T23:05:03.858960+0000","last_became_peered":"2023-09-29T23:05:03.858960+0000","last_unstale":"2023-09-29T23:05:03.859461+0000","last_undegraded":"2023-09-29T23:05:03.859461+0000","last_fullsized":"2023-09-29T23:05:03.859461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.857165+0000","last_change":"2023-09-29T23:05:03.857165+0000","last_active":"2023-09-29T23:05:03.857165+0000","last_peered":"2023-09-29T23:05:03.857165+0000","last_clean":"2023-09-29T23:05:03.857165+0000","last_became_active":"2023-09-29T23:05:03.856861+0000","last_became_peered":"2023-09-29T23:05:03.856861+0000","last_unstale":"2023-09-29T23:05:03.857165+0000","last_undegraded":"2023-09-29T23:05:03.857165+0000","last_fullsized":"2023-09-29T23:05:03.857165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:36:14.657609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849733+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:28:18.927748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.856407+0000","last_change":"2023-09-29T23:05:03.856407+0000","last_active":"2023-09-29T23:05:03.856407+0000","last_peered":"2023-09-29T23:05:03.856407+0000","last_clean":"2023-09-29T23:05:03.856407+0000","last_became_active":"2023-09-29T23:05:03.855984+0000","last_became_peered":"2023-09-29T23:05:03.855984+0000","last_unstale":"2023-09-29T23:05:03.856407+0000","last_undegraded":"2023-09-29T23:05:03.856407+0000","last_fullsized":"2023-09-29T23:05:03.856407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:46:25.574473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852141+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:32:47.567597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846381+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:13.653906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":5,"reported_epoch":18,"state":"active","last_fresh":"2023-09-29T23:05:03.880964+0000","last_change":"2023-09-29T23:05:03.880964+0000","last_active":"2023-09-29T23:05:03.880964+0000","last_peered":"2023-09-29T23:05:03.880964+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"2023-09-29T23:05:03.880964+0000","last_became_peered":"2023-09-29T23:05:03.880964+0000","last_unstale":"2023-09-29T23:05:03.880964+0000","last_undegraded":"2023-09-29T23:05:03.880964+0000","last_fullsized":"2023-09-29T23:05:03.880964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:15:36.235024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849143+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:56.707907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.835998+0000","last_change":"2023-09-29T23:05:03.836362+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.835998+0000","last_undegraded":"2023-09-29T23:05:03.835998+0000","last_fullsized":"2023-09-29T23:05:03.835998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851924+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:14:55.197436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.857474+0000","last_change":"2023-09-29T23:05:03.857474+0000","last_active":"2023-09-29T23:05:03.857474+0000","last_peered":"2023-09-29T23:05:03.857474+0000","last_clean":"2023-09-29T23:05:03.857474+0000","last_became_active":"2023-09-29T23:05:03.857167+0000","last_became_peered":"2023-09-29T23:05:03.857167+0000","last_unstale":"2023-09-29T23:05:03.857474+0000","last_undegraded":"2023-09-29T23:05:03.857474+0000","last_fullsized":"2023-09-29T23:05:03.857474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:31.923909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845001+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:29:32.421135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.860723+0000","last_change":"2023-09-29T23:05:03.861113+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.860723+0000","last_undegraded":"2023-09-29T23:05:03.860723+0000","last_fullsized":"2023-09-29T23:05:03.860723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.844867+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:52:36.204606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.836312+0000","last_change":"2023-09-29T23:05:03.836671+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.836312+0000","last_undegraded":"2023-09-29T23:05:03.836312+0000","last_fullsized":"2023-09-29T23:05:03.836312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849156+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:03:27.134395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.852972+0000","last_change":"2023-09-29T23:05:03.852972+0000","last_active":"2023-09-29T23:05:03.852972+0000","last_peered":"2023-09-29T23:05:03.852972+0000","last_clean":"2023-09-29T23:05:03.852972+0000","last_became_active":"2023-09-29T23:05:03.852482+0000","last_became_peered":"2023-09-29T23:05:03.852482+0000","last_unstale":"2023-09-29T23:05:03.852972+0000","last_undegraded":"2023-09-29T23:05:03.852972+0000","last_fullsized":"2023-09-29T23:05:03.852972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:00.205324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848712+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:01.217080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.865954+0000","last_change":"2023-09-29T23:05:03.865954+0000","last_active":"2023-09-29T23:05:03.865954+0000","last_peered":"2023-09-29T23:05:03.865954+0000","last_clean":"2023-09-29T23:05:03.865954+0000","last_became_active":"2023-09-29T23:05:03.862839+0000","last_became_peered":"2023-09-29T23:05:03.862839+0000","last_unstale":"2023-09-29T23:05:03.865954+0000","last_undegraded":"2023-09-29T23:05:03.865954+0000","last_fullsized":"2023-09-29T23:05:03.865954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:51:59.213175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.842196+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:07:06.833043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.850861+0000","last_change":"2023-09-29T23:05:03.850861+0000","last_active":"2023-09-29T23:05:03.850861+0000","last_peered":"2023-09-29T23:05:03.850861+0000","last_clean":"2023-09-29T23:05:03.850861+0000","last_became_active":"2023-09-29T23:05:03.848098+0000","last_became_peered":"2023-09-29T23:05:03.848098+0000","last_unstale":"2023-09-29T23:05:03.850861+0000","last_undegraded":"2023-09-29T23:05:03.850861+0000","last_fullsized":"2023-09-29T23:05:03.850861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795932,"kb_used_data":92903536,"kb_used_omap":62,"kb_used_meta":0,"kb_avail":92903448,"statfs":{"total":95948165120,"available":95133130752,"internally_reserved":90112,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63692,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":13,"commit_latency_ns":0,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797092,"kb_used_data":92902320,"kb_used_omap":124,"kb_used_meta":0,"kb_avail":92902288,"statfs":{"total":95948165120,"available":95131942912,"internally_reserved":32768,"allocated":95131975680,"data_stored":95131975680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":127133,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797140,"kb_used_data":92902320,"kb_used_omap":139,"kb_used_meta":0,"kb_avail":92902240,"statfs":{"total":95948165120,"available":95131893760,"internally_reserved":81920,"allocated":95131975680,"data_stored":95131975680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":142784,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":3,"commit_latency_ns":0,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795964,"kb_used_data":92903536,"kb_used_omap":85,"kb_used_meta":0,"kb_avail":92903416,"statfs":{"total":95948165120,"available":95133097984,"internally_reserved":122880,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87395,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":18,"commit_latency_ns":0,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]}],"pool_statfs":[]}} 2023-09-29T23:05:07.522 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:05:07.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.625+0000 7fef65376700 1 Processor -- start 2023-09-29T23:05:07.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.625+0000 7fef65376700 1 -- start start 2023-09-29T23:05:07.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef65376700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 0x7fef6009c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef65376700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fef6009dc30 0x7fef6009e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef65376700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6013d150 con 0x7fef6009d470 2023-09-29T23:05:07.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef65376700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6006a940 con 0x7fef6009dc30 2023-09-29T23:05:07.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef65376700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6006a060 con 0x7fef60069c90 2023-09-29T23:05:07.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef5ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 0x7fef6009c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef5ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 0x7fef6009c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33132/0 (socket says 172.21.15.115:33132) 2023-09-29T23:05:07.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef5ffff700 1 -- 172.21.15.115:0/2268838715 learned_addr learned my addr 172.21.15.115:0/2268838715 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:07.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef5f7fe700 1 --2- 172.21.15.115:0/2268838715 >> v2:172.21.15.156:3300/0 conn(0x7fef6009dc30 0x7fef6009e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef5f7fe700 1 -- 172.21.15.115:0/2268838715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 msgr2=0x7fef6009c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:07.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef5f7fe700 1 --2- 172.21.15.115:0/2268838715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 0x7fef6009c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef5f7fe700 1 -- 172.21.15.115:0/2268838715 >> v1:172.21.15.156:6789/0 conn(0x7fef6009d470 legacy=0x7fef6013ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef5f7fe700 1 -- 172.21.15.115:0/2268838715 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6009ec50 con 0x7fef6009dc30 2023-09-29T23:05:07.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef5ffff700 1 --2- 172.21.15.115:0/2268838715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 0x7fef6009c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:07.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef5f7fe700 1 --2- 172.21.15.115:0/2268838715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6009dc30 0x7fef6009e330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef50009e60 tx=0x7fef50009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d97e2600ebeceedf server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:07.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef5effd700 1 -- 172.21.15.115:0/2268838715 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5000e070 con 0x7fef6009dc30 2023-09-29T23:05:07.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef5effd700 1 -- 172.21.15.115:0/2268838715 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5000bb60 con 0x7fef6009dc30 2023-09-29T23:05:07.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef5effd700 1 -- 172.21.15.115:0/2268838715 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50012430 con 0x7fef6009dc30 2023-09-29T23:05:07.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef65376700 1 -- 172.21.15.115:0/2268838715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6009dc30 msgr2=0x7fef6009e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef65376700 1 --2- 172.21.15.115:0/2268838715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6009dc30 0x7fef6009e330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef50009e60 tx=0x7fef50009780 comp rx=0 tx=0).stop 2023-09-29T23:05:07.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef65376700 1 -- 172.21.15.115:0/2268838715 shutdown_connections 2023-09-29T23:05:07.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef65376700 1 --2- 172.21.15.115:0/2268838715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6009dc30 0x7fef6009e330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef65376700 1 --2- 172.21.15.115:0/2268838715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 0x7fef6009c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef65376700 1 -- 172.21.15.115:0/2268838715 >> 172.21.15.115:0/2268838715 conn(0x7fef600a2a60 msgr2=0x7fef600a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:07.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef65376700 1 -- 172.21.15.115:0/2268838715 shutdown_connections 2023-09-29T23:05:07.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.629+0000 7fef65376700 1 -- 172.21.15.115:0/2268838715 wait complete. 2023-09-29T23:05:07.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef65376700 1 Processor -- start 2023-09-29T23:05:07.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef65376700 1 -- start start 2023-09-29T23:05:07.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef65376700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 0x7fef6013bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef65376700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6009d470 0x7fef600a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef65376700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef6009dc30 0x7fef6006cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef65376700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef600a0070 con 0x7fef6009dc30 2023-09-29T23:05:07.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef65376700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6006d610 con 0x7fef6009d470 2023-09-29T23:05:07.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef65376700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6006d8d0 con 0x7fef60069c90 2023-09-29T23:05:07.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef5ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 0x7fef6013bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef5ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 0x7fef6013bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33140/0 (socket says 172.21.15.115:33140) 2023-09-29T23:05:07.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef64b75700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef6009dc30 0x7fef6006cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef5ffff700 1 -- 172.21.15.115:0/3602759567 learned_addr learned my addr 172.21.15.115:0/3602759567 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:07.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef5f7fe700 1 --2- 172.21.15.115:0/3602759567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6009d470 0x7fef600a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef5ffff700 1 -- 172.21.15.115:0/3602759567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6009d470 msgr2=0x7fef600a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef5ffff700 1 --2- 172.21.15.115:0/3602759567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6009d470 0x7fef600a0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef5ffff700 1 -- 172.21.15.115:0/3602759567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef6009dc30 msgr2=0x7fef6006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef5ffff700 1 --2- 172.21.15.115:0/3602759567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef6009dc30 0x7fef6006cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef5ffff700 1 -- 172.21.15.115:0/3602759567 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef480094f0 con 0x7fef60069c90 2023-09-29T23:05:07.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef5ffff700 1 --2- 172.21.15.115:0/3602759567 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 0x7fef6013bb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef4800ec50 tx=0x7fef48009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:07.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef57fff700 1 -- 172.21.15.115:0/3602759567 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4800c8e0 con 0x7fef60069c90 2023-09-29T23:05:07.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef57fff700 1 -- 172.21.15.115:0/3602759567 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4800ca40 con 0x7fef60069c90 2023-09-29T23:05:07.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef65376700 1 -- 172.21.15.115:0/3602759567 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef50009a20 con 0x7fef60069c90 2023-09-29T23:05:07.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef57fff700 1 -- 172.21.15.115:0/3602759567 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4800cde0 con 0x7fef60069c90 2023-09-29T23:05:07.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.633+0000 7fef65376700 1 -- 172.21.15.115:0/3602759567 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef600a0850 con 0x7fef60069c90 2023-09-29T23:05:07.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.637+0000 7fef65376700 1 -- 172.21.15.115:0/3602759567 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6004be00 con 0x7fef60069c90 2023-09-29T23:05:07.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.637+0000 7fef57fff700 1 -- 172.21.15.115:0/3602759567 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fef48013680 con 0x7fef60069c90 2023-09-29T23:05:07.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.637+0000 7fef57fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:07.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.637+0000 7fef57fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:07.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.637+0000 7fef57fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:07.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.637+0000 7fef57fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:07.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.637+0000 7fef57fff700 1 --2- 172.21.15.115:0/3602759567 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef4008e8b0 0x7fef40090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.637+0000 7fef57fff700 1 -- 172.21.15.115:0/3602759567 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fef480b4c70 con 0x7fef60069c90 2023-09-29T23:05:07.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.637+0000 7fef5f7fe700 1 --2- 172.21.15.115:0/3602759567 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef4008e8b0 0x7fef40090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.637+0000 7fef5f7fe700 1 --2- 172.21.15.115:0/3602759567 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef4008e8b0 0x7fef40090d60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef500097c0 tx=0x7fef50019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:07.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.645+0000 7fef57fff700 1 -- 172.21.15.115:0/3602759567 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fef48085600 con 0x7fef60069c90 2023-09-29T23:05:07.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.801+0000 7fef65376700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-29T23:05:07.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.801+0000 7fef65376700 1 -- 172.21.15.115:0/3602759567 --> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef600a0b00 con 0x7fef4008e8b0 2023-09-29T23:05:07.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.813+0000 7fef57fff700 1 -- 172.21.15.115:0/3602759567 <== mgr.4107 v2:172.21.15.156:6824/26644 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263179 (secure 0 0 0) 0x7fef5000be10 con 0x7fef4008e8b0 2023-09-29T23:05:07.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.813+0000 7fef57fff700 20 mgrc handle_command_reply tid 0 r 0 2023-09-29T23:05:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:07.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.821+0000 7fef65376700 10 mgrc shutdown 2023-09-29T23:05:07.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.821+0000 7fef65376700 1 -- 172.21.15.115:0/3602759567 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef4008e8b0 msgr2=0x7fef40090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.821+0000 7fef65376700 1 --2- 172.21.15.115:0/3602759567 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef4008e8b0 0x7fef40090d60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef500097c0 tx=0x7fef50019000 comp rx=0 tx=0).stop 2023-09-29T23:05:07.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.821+0000 7fef65376700 1 -- 172.21.15.115:0/3602759567 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 msgr2=0x7fef6013bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.821+0000 7fef65376700 1 --2- 172.21.15.115:0/3602759567 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 0x7fef6013bb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef4800ec50 tx=0x7fef48009250 comp rx=0 tx=0).stop 2023-09-29T23:05:07.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.821+0000 7fef65376700 1 -- 172.21.15.115:0/3602759567 shutdown_connections 2023-09-29T23:05:07.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.821+0000 7fef65376700 1 --2- 172.21.15.115:0/3602759567 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef4008e8b0 0x7fef40090d60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.821+0000 7fef65376700 1 --2- 172.21.15.115:0/3602759567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef6009dc30 0x7fef6006cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.821+0000 7fef65376700 1 --2- 172.21.15.115:0/3602759567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef6009d470 0x7fef600a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.821+0000 7fef65376700 1 --2- 172.21.15.115:0/3602759567 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef60069c90 0x7fef6013bb60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.821+0000 7fef65376700 1 -- 172.21.15.115:0/3602759567 >> 172.21.15.115:0/3602759567 conn(0x7fef600a2a60 msgr2=0x7fef6013c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:07.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.821+0000 7fef65376700 1 -- 172.21.15.115:0/3602759567 shutdown_connections 2023-09-29T23:05:07.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.821+0000 7fef65376700 1 -- 172.21.15.115:0/3602759567 wait complete. 2023-09-29T23:05:07.825 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-09-29T23:05:07.835 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-09-29T23:05:06.838917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":374797520,"kb_used":3186128,"kb_used_data":371611712,"kb_used_omap":411,"kb_used_meta":0,"kb_avail":371611392,"statfs":{"total":383792660480,"available":380530065408,"internally_reserved":327680,"allocated":380530393088,"data_stored":380530393088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":421004,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":38,"commit_latency_ns":0,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.016922"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.847662+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:08.282524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851614+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:02:45.413482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851733+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:00:59.236159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.855729+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:18:29.699338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848212+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:32.935665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849677+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:36:15.669365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.855865+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:44:09.433237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850208+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:12:54.806149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845935+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:23:08.165955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854400+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:18.681401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852032+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:31:53.623960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845938+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:45:19.820523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845307+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:43:42.473330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850142+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:27:03.221776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850370+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:04:36.437126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849281+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:17.918744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854525+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:03.578342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850342+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:27:58.793491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846337+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:07:57.307417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854802+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:33:35.631951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846830+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:50:45.952748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854277+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:02:48.471581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.853990+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:08:59.954277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848560+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:42:07.158440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.853767+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:33:00.710798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852737+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:46:23.962799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851165+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:28.548035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.853518+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:29:45.889254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848629+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:53.841175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850688+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:34:48.714874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851975+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:44:09.407881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846528+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:03:01.571565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852969+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:51:24.073380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.860892+0000","last_change":"2023-09-29T23:05:03.861608+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.860892+0000","last_undegraded":"2023-09-29T23:05:03.860892+0000","last_fullsized":"2023-09-29T23:05:03.860892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850896+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:42:01.814209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.840810+0000","last_change":"2023-09-29T23:05:03.841192+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.840810+0000","last_undegraded":"2023-09-29T23:05:03.840810+0000","last_fullsized":"2023-09-29T23:05:03.840810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.855304+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:46:44.253356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.841828+0000","last_change":"2023-09-29T23:05:03.842249+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.841828+0000","last_undegraded":"2023-09-29T23:05:03.841828+0000","last_fullsized":"2023-09-29T23:05:03.841828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:27:57.781735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849989+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:38.742119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.849842+0000","last_change":"2023-09-29T23:05:03.849842+0000","last_active":"2023-09-29T23:05:03.849842+0000","last_peered":"2023-09-29T23:05:03.849842+0000","last_clean":"2023-09-29T23:05:03.849842+0000","last_became_active":"2023-09-29T23:05:03.849529+0000","last_became_peered":"2023-09-29T23:05:03.849529+0000","last_unstale":"2023-09-29T23:05:03.849842+0000","last_undegraded":"2023-09-29T23:05:03.849842+0000","last_fullsized":"2023-09-29T23:05:03.849842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.853590+0000","last_change":"2023-09-29T23:05:03.853590+0000","last_active":"2023-09-29T23:05:03.853590+0000","last_peered":"2023-09-29T23:05:03.853590+0000","last_clean":"2023-09-29T23:05:03.853590+0000","last_became_active":"2023-09-29T23:05:03.853335+0000","last_became_peered":"2023-09-29T23:05:03.853335+0000","last_unstale":"2023-09-29T23:05:03.853590+0000","last_undegraded":"2023-09-29T23:05:03.853590+0000","last_fullsized":"2023-09-29T23:05:03.853590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:57:20.234700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851633+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:22:14.141803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.853815+0000","last_change":"2023-09-29T23:05:03.853815+0000","last_active":"2023-09-29T23:05:03.853815+0000","last_peered":"2023-09-29T23:05:03.853815+0000","last_clean":"2023-09-29T23:05:03.853815+0000","last_became_active":"2023-09-29T23:05:03.853456+0000","last_became_peered":"2023-09-29T23:05:03.853456+0000","last_unstale":"2023-09-29T23:05:03.853815+0000","last_undegraded":"2023-09-29T23:05:03.853815+0000","last_fullsized":"2023-09-29T23:05:03.853815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848355+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:28:39.908387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.844642+0000","last_change":"2023-09-29T23:05:03.846600+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.844642+0000","last_undegraded":"2023-09-29T23:05:03.844642+0000","last_fullsized":"2023-09-29T23:05:03.844642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:37.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848753+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:57:25.282750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.844114+0000","last_change":"2023-09-29T23:05:03.844675+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.844114+0000","last_undegraded":"2023-09-29T23:05:03.844114+0000","last_fullsized":"2023-09-29T23:05:03.844114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:52.829419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.843763+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:41:32.696950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.879324+0000","last_change":"2023-09-29T23:05:03.879324+0000","last_active":"2023-09-29T23:05:03.879324+0000","last_peered":"2023-09-29T23:05:03.879324+0000","last_clean":"2023-09-29T23:05:03.879324+0000","last_became_active":"2023-09-29T23:05:03.874684+0000","last_became_peered":"2023-09-29T23:05:03.874684+0000","last_unstale":"2023-09-29T23:05:03.879324+0000","last_undegraded":"2023-09-29T23:05:03.879324+0000","last_fullsized":"2023-09-29T23:05:03.879324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:07:10.402882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851535+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:08:19.473130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.851543+0000","last_change":"2023-09-29T23:05:03.851543+0000","last_active":"2023-09-29T23:05:03.851543+0000","last_peered":"2023-09-29T23:05:03.851543+0000","last_clean":"2023-09-29T23:05:03.851543+0000","last_became_active":"2023-09-29T23:05:03.849728+0000","last_became_peered":"2023-09-29T23:05:03.849728+0000","last_unstale":"2023-09-29T23:05:03.851543+0000","last_undegraded":"2023-09-29T23:05:03.851543+0000","last_fullsized":"2023-09-29T23:05:03.851543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850615+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:08:43.654146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.873312+0000","last_change":"2023-09-29T23:05:03.873312+0000","last_active":"2023-09-29T23:05:03.873312+0000","last_peered":"2023-09-29T23:05:03.873312+0000","last_clean":"2023-09-29T23:05:03.873312+0000","last_became_active":"2023-09-29T23:05:03.867491+0000","last_became_peered":"2023-09-29T23:05:03.867491+0000","last_unstale":"2023-09-29T23:05:03.873312+0000","last_undegraded":"2023-09-29T23:05:03.873312+0000","last_fullsized":"2023-09-29T23:05:03.873312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:21:38.208894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.843629+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:25.767254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.878136+0000","last_change":"2023-09-29T23:05:03.878136+0000","last_active":"2023-09-29T23:05:03.878136+0000","last_peered":"2023-09-29T23:05:03.878136+0000","last_clean":"2023-09-29T23:05:03.878136+0000","last_became_active":"2023-09-29T23:05:03.872575+0000","last_became_peered":"2023-09-29T23:05:03.872575+0000","last_unstale":"2023-09-29T23:05:03.878136+0000","last_undegraded":"2023-09-29T23:05:03.878136+0000","last_fullsized":"2023-09-29T23:05:03.878136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:18:45.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849714+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:47:02.919688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822229+0000","last_change":"2023-09-29T23:04:56.664338+0000","last_active":"2023-09-29T23:05:02.822229+0000","last_peered":"2023-09-29T23:05:02.822229+0000","last_clean":"2023-09-29T23:05:02.822229+0000","last_became_active":"2023-09-29T23:04:56.663441+0000","last_became_peered":"2023-09-29T23:04:56.663441+0000","last_unstale":"2023-09-29T23:05:02.822229+0000","last_undegraded":"2023-09-29T23:05:02.822229+0000","last_fullsized":"2023-09-29T23:05:02.822229+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_clean_scrub_stamp":"2023-09-29T23:04:55.640704+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:54:28.112724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.825047+0000","last_change":"2023-09-29T23:04:59.797078+0000","last_active":"2023-09-29T23:05:02.825047+0000","last_peered":"2023-09-29T23:05:02.825047+0000","last_clean":"2023-09-29T23:05:02.825047+0000","last_became_active":"2023-09-29T23:04:59.795998+0000","last_became_peered":"2023-09-29T23:04:59.795998+0000","last_unstale":"2023-09-29T23:05:02.825047+0000","last_undegraded":"2023-09-29T23:05:02.825047+0000","last_fullsized":"2023-09-29T23:05:02.825047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.861050+0000","last_change":"2023-09-29T23:05:03.861201+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.861050+0000","last_undegraded":"2023-09-29T23:05:03.861050+0000","last_fullsized":"2023-09-29T23:05:03.861050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:56:45.933376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849867+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:11:05.030356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822981+0000","last_change":"2023-09-29T23:04:59.798054+0000","last_active":"2023-09-29T23:05:02.822981+0000","last_peered":"2023-09-29T23:05:02.822981+0000","last_clean":"2023-09-29T23:05:02.822981+0000","last_became_active":"2023-09-29T23:04:59.797489+0000","last_became_peered":"2023-09-29T23:04:59.797489+0000","last_unstale":"2023-09-29T23:05:02.822981+0000","last_undegraded":"2023-09-29T23:05:02.822981+0000","last_fullsized":"2023-09-29T23:05:02.822981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:32:42.777486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.851676+0000","last_change":"2023-09-29T23:05:03.851676+0000","last_active":"2023-09-29T23:05:03.851676+0000","last_peered":"2023-09-29T23:05:03.851676+0000","last_clean":"2023-09-29T23:05:03.851676+0000","last_became_active":"2023-09-29T23:05:03.851368+0000","last_became_peered":"2023-09-29T23:05:03.851368+0000","last_unstale":"2023-09-29T23:05:03.851676+0000","last_undegraded":"2023-09-29T23:05:03.851676+0000","last_fullsized":"2023-09-29T23:05:03.851676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:43:41.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854744+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:50:01.256063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.823215+0000","last_change":"2023-09-29T23:04:59.951828+0000","last_active":"2023-09-29T23:05:02.823215+0000","last_peered":"2023-09-29T23:05:02.823215+0000","last_clean":"2023-09-29T23:05:02.823215+0000","last_became_active":"2023-09-29T23:04:59.951181+0000","last_became_peered":"2023-09-29T23:04:59.951181+0000","last_unstale":"2023-09-29T23:05:02.823215+0000","last_undegraded":"2023-09-29T23:05:02.823215+0000","last_fullsized":"2023-09-29T23:05:02.823215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.847255+0000","last_change":"2023-09-29T23:05:03.847255+0000","last_active":"2023-09-29T23:05:03.847255+0000","last_peered":"2023-09-29T23:05:03.847255+0000","last_clean":"2023-09-29T23:05:03.847255+0000","last_became_active":"2023-09-29T23:05:03.846967+0000","last_became_peered":"2023-09-29T23:05:03.846967+0000","last_unstale":"2023-09-29T23:05:03.847255+0000","last_undegraded":"2023-09-29T23:05:03.847255+0000","last_fullsized":"2023-09-29T23:05:03.847255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:41:31.685195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848434+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:44:09.433237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.825640+0000","last_change":"2023-09-29T23:04:59.797795+0000","last_active":"2023-09-29T23:05:02.825640+0000","last_peered":"2023-09-29T23:05:02.825640+0000","last_clean":"2023-09-29T23:05:02.825640+0000","last_became_active":"2023-09-29T23:04:59.796512+0000","last_became_peered":"2023-09-29T23:04:59.796512+0000","last_unstale":"2023-09-29T23:05:02.825640+0000","last_undegraded":"2023-09-29T23:05:02.825640+0000","last_fullsized":"2023-09-29T23:05:02.825640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.848672+0000","last_change":"2023-09-29T23:05:03.848672+0000","last_active":"2023-09-29T23:05:03.848672+0000","last_peered":"2023-09-29T23:05:03.848672+0000","last_clean":"2023-09-29T23:05:03.848672+0000","last_became_active":"2023-09-29T23:05:03.848507+0000","last_became_peered":"2023-09-29T23:05:03.848507+0000","last_unstale":"2023-09-29T23:05:03.848672+0000","last_undegraded":"2023-09-29T23:05:03.848672+0000","last_fullsized":"2023-09-29T23:05:03.848672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:19:37.297844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848355+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:46:40.708391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.844413+0000","last_change":"2023-09-29T23:05:03.845055+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.844413+0000","last_undegraded":"2023-09-29T23:05:03.844413+0000","last_fullsized":"2023-09-29T23:05:03.844413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:28:17.915992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822652+0000","last_change":"2023-09-29T23:04:59.952454+0000","last_active":"2023-09-29T23:05:02.822652+0000","last_peered":"2023-09-29T23:05:02.822652+0000","last_clean":"2023-09-29T23:05:02.822652+0000","last_became_active":"2023-09-29T23:04:59.951496+0000","last_became_peered":"2023-09-29T23:04:59.951496+0000","last_unstale":"2023-09-29T23:05:02.822652+0000","last_undegraded":"2023-09-29T23:05:02.822652+0000","last_fullsized":"2023-09-29T23:05:02.822652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.847097+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:50:01.256063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.855922+0000","last_change":"2023-09-29T23:05:03.855922+0000","last_active":"2023-09-29T23:05:03.855922+0000","last_peered":"2023-09-29T23:05:03.855922+0000","last_clean":"2023-09-29T23:05:03.855922+0000","last_became_active":"2023-09-29T23:05:03.851814+0000","last_became_peered":"2023-09-29T23:05:03.851814+0000","last_unstale":"2023-09-29T23:05:03.855922+0000","last_undegraded":"2023-09-29T23:05:03.855922+0000","last_fullsized":"2023-09-29T23:05:03.855922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:29:31.409379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.826355+0000","last_change":"2023-09-29T23:04:59.798170+0000","last_active":"2023-09-29T23:05:02.826355+0000","last_peered":"2023-09-29T23:05:02.826355+0000","last_clean":"2023-09-29T23:05:02.826355+0000","last_became_active":"2023-09-29T23:04:59.797758+0000","last_became_peered":"2023-09-29T23:04:59.797758+0000","last_unstale":"2023-09-29T23:05:02.826355+0000","last_undegraded":"2023-09-29T23:05:02.826355+0000","last_fullsized":"2023-09-29T23:05:02.826355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:23.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845914+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:32:47.567597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":7,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.879328+0000","last_change":"2023-09-29T23:05:03.879418+0000","last_active":"2023-09-29T23:05:03.879328+0000","last_peered":"2023-09-29T23:05:03.879328+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"2023-09-29T23:05:03.875943+0000","last_became_peered":"2023-09-29T23:05:03.875943+0000","last_unstale":"2023-09-29T23:05:03.879328+0000","last_undegraded":"2023-09-29T23:05:03.879328+0000","last_fullsized":"2023-09-29T23:05:03.879328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:22:16.497716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822477+0000","last_change":"2023-09-29T23:04:59.794782+0000","last_active":"2023-09-29T23:05:02.822477+0000","last_peered":"2023-09-29T23:05:02.822477+0000","last_clean":"2023-09-29T23:05:02.822477+0000","last_became_active":"2023-09-29T23:04:59.794073+0000","last_became_peered":"2023-09-29T23:04:59.794073+0000","last_unstale":"2023-09-29T23:05:02.822477+0000","last_undegraded":"2023-09-29T23:05:02.822477+0000","last_fullsized":"2023-09-29T23:05:02.822477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:44:24.462680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846593+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:47.915370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.851188+0000","last_change":"2023-09-29T23:05:03.851188+0000","last_active":"2023-09-29T23:05:03.851188+0000","last_peered":"2023-09-29T23:05:03.851188+0000","last_clean":"2023-09-29T23:05:03.851188+0000","last_became_active":"2023-09-29T23:05:03.850904+0000","last_became_peered":"2023-09-29T23:05:03.850904+0000","last_unstale":"2023-09-29T23:05:03.851188+0000","last_undegraded":"2023-09-29T23:05:03.851188+0000","last_fullsized":"2023-09-29T23:05:03.851188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:24.755498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.826148+0000","last_change":"2023-09-29T23:04:59.799021+0000","last_active":"2023-09-29T23:05:02.826148+0000","last_peered":"2023-09-29T23:05:02.826148+0000","last_clean":"2023-09-29T23:05:02.826148+0000","last_became_active":"2023-09-29T23:04:59.797145+0000","last_became_peered":"2023-09-29T23:04:59.797145+0000","last_unstale":"2023-09-29T23:05:02.826148+0000","last_undegraded":"2023-09-29T23:05:02.826148+0000","last_fullsized":"2023-09-29T23:05:02.826148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:46:55.987895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.843218+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:15:37.246780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.844309+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:22:17.509472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.853192+0000","last_change":"2023-09-29T23:05:03.853192+0000","last_active":"2023-09-29T23:05:03.853192+0000","last_peered":"2023-09-29T23:05:03.853192+0000","last_clean":"2023-09-29T23:05:03.853192+0000","last_became_active":"2023-09-29T23:05:03.852382+0000","last_became_peered":"2023-09-29T23:05:03.852382+0000","last_unstale":"2023-09-29T23:05:03.853192+0000","last_undegraded":"2023-09-29T23:05:03.853192+0000","last_fullsized":"2023-09-29T23:05:03.853192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:49:53.513521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849855+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:46:44.253356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":7,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.859461+0000","last_change":"2023-09-29T23:05:03.859535+0000","last_active":"2023-09-29T23:05:03.859461+0000","last_peered":"2023-09-29T23:05:03.859461+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"2023-09-29T23:05:03.858960+0000","last_became_peered":"2023-09-29T23:05:03.858960+0000","last_unstale":"2023-09-29T23:05:03.859461+0000","last_undegraded":"2023-09-29T23:05:03.859461+0000","last_fullsized":"2023-09-29T23:05:03.859461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.857165+0000","last_change":"2023-09-29T23:05:03.857165+0000","last_active":"2023-09-29T23:05:03.857165+0000","last_peered":"2023-09-29T23:05:03.857165+0000","last_clean":"2023-09-29T23:05:03.857165+0000","last_became_active":"2023-09-29T23:05:03.856861+0000","last_became_peered":"2023-09-29T23:05:03.856861+0000","last_unstale":"2023-09-29T23:05:03.857165+0000","last_undegraded":"2023-09-29T23:05:03.857165+0000","last_fullsized":"2023-09-29T23:05:03.857165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:36:14.657609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849733+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:28:18.927748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.856407+0000","last_change":"2023-09-29T23:05:03.856407+0000","last_active":"2023-09-29T23:05:03.856407+0000","last_peered":"2023-09-29T23:05:03.856407+0000","last_clean":"2023-09-29T23:05:03.856407+0000","last_became_active":"2023-09-29T23:05:03.855984+0000","last_became_peered":"2023-09-29T23:05:03.855984+0000","last_unstale":"2023-09-29T23:05:03.856407+0000","last_undegraded":"2023-09-29T23:05:03.856407+0000","last_fullsized":"2023-09-29T23:05:03.856407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:46:25.574473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852141+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:32:47.567597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846381+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:13.653906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":5,"reported_epoch":18,"state":"active","last_fresh":"2023-09-29T23:05:03.880964+0000","last_change":"2023-09-29T23:05:03.880964+0000","last_active":"2023-09-29T23:05:03.880964+0000","last_peered":"2023-09-29T23:05:03.880964+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"2023-09-29T23:05:03.880964+0000","last_became_peered":"2023-09-29T23:05:03.880964+0000","last_unstale":"2023-09-29T23:05:03.880964+0000","last_undegraded":"2023-09-29T23:05:03.880964+0000","last_fullsized":"2023-09-29T23:05:03.880964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:15:36.235024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849143+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:56.707907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.835998+0000","last_change":"2023-09-29T23:05:03.836362+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.835998+0000","last_undegraded":"2023-09-29T23:05:03.835998+0000","last_fullsized":"2023-09-29T23:05:03.835998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851924+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:14:55.197436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.857474+0000","last_change":"2023-09-29T23:05:03.857474+0000","last_active":"2023-09-29T23:05:03.857474+0000","last_peered":"2023-09-29T23:05:03.857474+0000","last_clean":"2023-09-29T23:05:03.857474+0000","last_became_active":"2023-09-29T23:05:03.857167+0000","last_became_peered":"2023-09-29T23:05:03.857167+0000","last_unstale":"2023-09-29T23:05:03.857474+0000","last_undegraded":"2023-09-29T23:05:03.857474+0000","last_fullsized":"2023-09-29T23:05:03.857474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:31.923909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845001+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:29:32.421135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.860723+0000","last_change":"2023-09-29T23:05:03.861113+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.860723+0000","last_undegraded":"2023-09-29T23:05:03.860723+0000","last_fullsized":"2023-09-29T23:05:03.860723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.844867+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:52:36.204606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.836312+0000","last_change":"2023-09-29T23:05:03.836671+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.836312+0000","last_undegraded":"2023-09-29T23:05:03.836312+0000","last_fullsized":"2023-09-29T23:05:03.836312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849156+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:03:27.134395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.852972+0000","last_change":"2023-09-29T23:05:03.852972+0000","last_active":"2023-09-29T23:05:03.852972+0000","last_peered":"2023-09-29T23:05:03.852972+0000","last_clean":"2023-09-29T23:05:03.852972+0000","last_became_active":"2023-09-29T23:05:03.852482+0000","last_became_peered":"2023-09-29T23:05:03.852482+0000","last_unstale":"2023-09-29T23:05:03.852972+0000","last_undegraded":"2023-09-29T23:05:03.852972+0000","last_fullsized":"2023-09-29T23:05:03.852972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:00.205324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848712+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:01.217080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.865954+0000","last_change":"2023-09-29T23:05:03.865954+0000","last_active":"2023-09-29T23:05:03.865954+0000","last_peered":"2023-09-29T23:05:03.865954+0000","last_clean":"2023-09-29T23:05:03.865954+0000","last_became_active":"2023-09-29T23:05:03.862839+0000","last_became_peered":"2023-09-29T23:05:03.862839+0000","last_unstale":"2023-09-29T23:05:03.865954+0000","last_undegraded":"2023-09-29T23:05:03.865954+0000","last_fullsized":"2023-09-29T23:05:03.865954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:51:59.213175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.842196+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:07:06.833043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.850861+0000","last_change":"2023-09-29T23:05:03.850861+0000","last_active":"2023-09-29T23:05:03.850861+0000","last_peered":"2023-09-29T23:05:03.850861+0000","last_clean":"2023-09-29T23:05:03.850861+0000","last_became_active":"2023-09-29T23:05:03.848098+0000","last_became_peered":"2023-09-29T23:05:03.848098+0000","last_unstale":"2023-09-29T23:05:03.850861+0000","last_undegraded":"2023-09-29T23:05:03.850861+0000","last_fullsized":"2023-09-29T23:05:03.850861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795932,"kb_used_data":92903536,"kb_used_omap":62,"kb_used_meta":0,"kb_avail":92903448,"statfs":{"total":95948165120,"available":95133130752,"internally_reserved":90112,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63692,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":13,"commit_latency_ns":0,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797092,"kb_used_data":92902320,"kb_used_omap":124,"kb_used_meta":0,"kb_avail":92902288,"statfs":{"total":95948165120,"available":95131942912,"internally_reserved":32768,"allocated":95131975680,"data_stored":95131975680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":127133,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797140,"kb_used_data":92902320,"kb_used_omap":139,"kb_used_meta":0,"kb_avail":92902240,"statfs":{"total":95948165120,"available":95131893760,"internally_reserved":81920,"allocated":95131975680,"data_stored":95131975680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":142784,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":3,"commit_latency_ns":0,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795964,"kb_used_data":92903536,"kb_used_omap":85,"kb_used_meta":0,"kb_avail":92903416,"statfs":{"total":95948165120,"available":95133097984,"internally_reserved":122880,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87395,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":18,"commit_latency_ns":0,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]}],"pool_statfs":[]}} 2023-09-29T23:05:07.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-09-29T23:05:07.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.847662+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T08:53:08.282524+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-29T23:05:07.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-09-29T23:05:07.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.851614+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T03:02:45.413482+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-09-29T23:05:07.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.851733+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:00:59.236159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-09-29T23:05:07.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.855729+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T09:18:29.699338+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-09-29T23:05:07.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.848212+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-09-30T23:19:32.935665+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-09-29T23:05:07.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.849677+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T10:36:15.669365+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-09-29T23:05:07.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.855865+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T00:44:09.433237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-09-29T23:05:07.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.850208+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T00:12:54.806149+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-09-29T23:05:07.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.845935+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T08:23:08.165955+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-29T23:05:07.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-09-29T23:05:07.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.854400+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T04:38:18.681401+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-09-29T23:05:07.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.852032+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T01:31:53.623960+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-09-29T23:05:07.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.845938+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:45:19.820523+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-29T23:05:07.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-09-29T23:05:07.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.845307+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T09:43:42.473330+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-29T23:05:07.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-09-29T23:05:07.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.850142+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-09-30T23:27:03.221776+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-09-29T23:05:07.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.850370+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T06:04:36.437126+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-09-29T23:05:07.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.849281+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T06:31:17.918744+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-09-29T23:05:07.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.854525+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T01:26:03.578342+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-09-29T23:05:07.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.850342+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T06:27:58.793491+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-09-29T23:05:07.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.846337+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T02:07:57.307417+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-29T23:05:07.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-09-29T23:05:07.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.854802+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T10:33:35.631951+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-09-29T23:05:07.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.846830+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T09:50:45.952748+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-09-29T23:05:07.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.854277+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T10:02:48.471581+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-09-29T23:05:07.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.853990+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T10:08:59.954277+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-09-29T23:05:07.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.848560+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T02:42:07.158440+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-09-29T23:05:07.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.853767+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T03:33:00.710798+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-09-29T23:05:07.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.852737+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T09:46:23.962799+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-09-29T23:05:07.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.851165+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T04:38:28.548035+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-09-29T23:05:07.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.853518+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T09:29:45.889254+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-09-29T23:05:07.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.848629+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T02:06:53.841175+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-09-29T23:05:07.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.850688+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T00:34:48.714874+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-09-29T23:05:07.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.851975+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T06:44:09.407881+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-09-29T23:05:07.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.846528+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:03:01.571565+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-09-29T23:05:07.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.852969+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T04:51:24.073380+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-09-29T23:05:07.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 18, 'state': 'creating+activating', 'last_fresh': '2023-09-29T23:05:03.860892+0000', 'last_change': '2023-09-29T23:05:03.861608+0000', 'last_active': '2023-09-29T23:05:02.809230+0000', 'last_peered': '2023-09-29T23:05:02.809230+0000', 'last_clean': '2023-09-29T23:05:02.809230+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.860892+0000', 'last_undegraded': '2023-09-29T23:05:03.860892+0000', 'last_fullsized': '2023-09-29T23:05:03.860892+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-09-29T23:05:07.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.850896+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T04:42:01.814209+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-09-29T23:05:07.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 18, 'state': 'creating+activating', 'last_fresh': '2023-09-29T23:05:03.840810+0000', 'last_change': '2023-09-29T23:05:03.841192+0000', 'last_active': '2023-09-29T23:05:02.809230+0000', 'last_peered': '2023-09-29T23:05:02.809230+0000', 'last_clean': '2023-09-29T23:05:02.809230+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.840810+0000', 'last_undegraded': '2023-09-29T23:05:03.840810+0000', 'last_fullsized': '2023-09-29T23:05:03.840810+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-29T23:05:07.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-09-29T23:05:07.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.855304+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T02:46:44.253356+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-09-29T23:05:07.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 18, 'state': 'creating+activating', 'last_fresh': '2023-09-29T23:05:03.841828+0000', 'last_change': '2023-09-29T23:05:03.842249+0000', 'last_active': '2023-09-29T23:05:02.809230+0000', 'last_peered': '2023-09-29T23:05:02.809230+0000', 'last_clean': '2023-09-29T23:05:02.809230+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.841828+0000', 'last_undegraded': '2023-09-29T23:05:03.841828+0000', 'last_fullsized': '2023-09-29T23:05:03.841828+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T06:27:57.781735+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-09-29T23:05:07.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.849989+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T06:05:38.742119+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-09-29T23:05:07.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.851633+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T10:22:14.141803+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-09-29T23:05:07.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.848355+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T05:28:39.908387+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-09-29T23:05:07.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 18, 'state': 'creating+activating', 'last_fresh': '2023-09-29T23:05:03.844642+0000', 'last_change': '2023-09-29T23:05:03.846600+0000', 'last_active': '2023-09-29T23:05:02.809230+0000', 'last_peered': '2023-09-29T23:05:02.809230+0000', 'last_clean': '2023-09-29T23:05:02.809230+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.844642+0000', 'last_undegraded': '2023-09-29T23:05:03.844642+0000', 'last_fullsized': '2023-09-29T23:05:03.844642+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T06:05:37.730363+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-09-29T23:05:07.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.848753+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T02:57:25.282750+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-09-29T23:05:07.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 18, 'state': 'creating+activating', 'last_fresh': '2023-09-29T23:05:03.844114+0000', 'last_change': '2023-09-29T23:05:03.844675+0000', 'last_active': '2023-09-29T23:05:02.809230+0000', 'last_peered': '2023-09-29T23:05:02.809230+0000', 'last_clean': '2023-09-29T23:05:02.809230+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.844114+0000', 'last_undegraded': '2023-09-29T23:05:03.844114+0000', 'last_fullsized': '2023-09-29T23:05:03.844114+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T02:06:52.829419+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-09-29T23:05:07.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.843763+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:41:32.696950+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-29T23:05:07.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-09-29T23:05:07.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.851535+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T01:08:19.473130+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-09-29T23:05:07.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.850615+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T03:08:43.654146+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-09-29T23:05:07.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.843629+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T06:05:25.767254+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-29T23:05:07.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-09-29T23:05:07.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.849714+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T03:47:02.919688+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-09-29T23:05:07.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 18, 'state': 'creating+activating', 'last_fresh': '2023-09-29T23:05:03.861050+0000', 'last_change': '2023-09-29T23:05:03.861201+0000', 'last_active': '2023-09-29T23:05:02.809230+0000', 'last_peered': '2023-09-29T23:05:02.809230+0000', 'last_clean': '2023-09-29T23:05:02.809230+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.861050+0000', 'last_undegraded': '2023-09-29T23:05:03.861050+0000', 'last_fullsized': '2023-09-29T23:05:03.861050+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T06:56:45.933376+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-09-29T23:05:07.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.849867+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T09:11:05.030356+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-09-29T23:05:07.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.854744+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T06:50:01.256063+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-09-29T23:05:07.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.848434+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T00:44:09.433237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-09-29T23:05:07.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.848355+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T04:46:40.708391+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-09-29T23:05:07.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 18, 'state': 'creating+activating', 'last_fresh': '2023-09-29T23:05:03.844413+0000', 'last_change': '2023-09-29T23:05:03.845055+0000', 'last_active': '2023-09-29T23:05:02.809230+0000', 'last_peered': '2023-09-29T23:05:02.809230+0000', 'last_clean': '2023-09-29T23:05:02.809230+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.844413+0000', 'last_undegraded': '2023-09-29T23:05:03.844413+0000', 'last_fullsized': '2023-09-29T23:05:03.844413+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T02:28:17.915992+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-09-29T23:05:07.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.847097+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T06:50:01.256063+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-09-29T23:05:07.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.845914+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T10:32:47.567597+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-09-29T23:05:07.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.846593+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T02:25:47.915370+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-09-29T23:05:07.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.843218+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-09-30T23:15:37.246780+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-29T23:05:07.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-09-29T23:05:07.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.844309+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:22:17.509472+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-29T23:05:07.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-09-29T23:05:07.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.849855+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T02:46:44.253356+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-09-29T23:05:07.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.849733+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T02:28:18.927748+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-09-29T23:05:07.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.852141+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T10:32:47.567597+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-09-29T23:05:07.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.846381+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T00:01:13.653906+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-09-29T23:05:07.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 5, 'reported_epoch': 18, 'state': 'active', 'last_fresh': '2023-09-29T23:05:03.880964+0000', 'last_change': '2023-09-29T23:05:03.880964+0000', 'last_active': '2023-09-29T23:05:03.880964+0000', 'last_peered': '2023-09-29T23:05:03.880964+0000', 'last_clean': '2023-09-29T23:05:02.809230+0000', 'last_became_active': '2023-09-29T23:05:03.880964+0000', 'last_became_peered': '2023-09-29T23:05:03.880964+0000', 'last_unstale': '2023-09-29T23:05:03.880964+0000', 'last_undegraded': '2023-09-29T23:05:03.880964+0000', 'last_fullsized': '2023-09-29T23:05:03.880964+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-09-30T23:15:36.235024+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-09-29T23:05:07.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.849143+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T01:26:56.707907+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-09-29T23:05:07.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 18, 'state': 'creating+activating', 'last_fresh': '2023-09-29T23:05:03.835998+0000', 'last_change': '2023-09-29T23:05:03.836362+0000', 'last_active': '2023-09-29T23:05:02.809230+0000', 'last_peered': '2023-09-29T23:05:02.809230+0000', 'last_clean': '2023-09-29T23:05:02.809230+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.835998+0000', 'last_undegraded': '2023-09-29T23:05:03.835998+0000', 'last_fullsized': '2023-09-29T23:05:03.835998+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-09-29T23:05:07.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.851924+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T08:14:55.197436+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-09-29T23:05:07.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.845001+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:29:32.421135+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-29T23:05:07.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-09-29T23:05:07.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 18, 'state': 'creating+activating', 'last_fresh': '2023-09-29T23:05:03.860723+0000', 'last_change': '2023-09-29T23:05:03.861113+0000', 'last_active': '2023-09-29T23:05:02.809230+0000', 'last_peered': '2023-09-29T23:05:02.809230+0000', 'last_clean': '2023-09-29T23:05:02.809230+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.860723+0000', 'last_undegraded': '2023-09-29T23:05:03.860723+0000', 'last_fullsized': '2023-09-29T23:05:03.860723+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-09-29T23:05:07.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.844867+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T08:52:36.204606+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-29T23:05:07.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-09-29T23:05:07.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 18, 'state': 'creating+activating', 'last_fresh': '2023-09-29T23:05:03.836312+0000', 'last_change': '2023-09-29T23:05:03.836671+0000', 'last_active': '2023-09-29T23:05:02.809230+0000', 'last_peered': '2023-09-29T23:05:02.809230+0000', 'last_clean': '2023-09-29T23:05:02.809230+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.836312+0000', 'last_undegraded': '2023-09-29T23:05:03.836312+0000', 'last_fullsized': '2023-09-29T23:05:03.836312+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:02.809230+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-29T23:05:07.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-09-29T23:05:07.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.849156+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T05:03:27.134395+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-09-29T23:05:07.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.848712+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T04:16:01.217080+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-29T23:05:07.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-09-29T23:05:07.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-29T23:05:03.820986+0000', 'last_change': '2023-09-29T23:05:03.842196+0000', 'last_active': '2023-09-29T23:05:03.820986+0000', 'last_peered': '2023-09-29T23:05:03.820986+0000', 'last_clean': '2023-09-29T23:05:03.820986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-29T23:05:03.820986+0000', 'last_undegraded': '2023-09-29T23:05:03.820986+0000', 'last_fullsized': '2023-09-29T23:05:03.820986+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'last_clean_scrub_stamp': '2023-09-29T23:05:03.820986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T05:07:06.833043+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-29T23:05:07.859 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-29T23:05:07.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed0afcc700 1 Processor -- start 2023-09-29T23:05:07.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed0afcc700 1 -- start start 2023-09-29T23:05:07.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed0afcc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fed0409a050 0x7fed0414b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed0afcc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed040a4550 con 0x7fed04135b90 2023-09-29T23:05:07.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed0afcc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed04099870 con 0x7fed04135f60 2023-09-29T23:05:07.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed0afcc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed040a3fd0 con 0x7fed0409a050 2023-09-29T23:05:07.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed09fca700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fed04135b90 0x7fed040a3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41664/0 (socket says 172.21.15.115:41664) 2023-09-29T23:05:07.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed09fca700 1 -- 172.21.15.115:0/3393792289 learned_addr learned my addr 172.21.15.115:0/3393792289 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:07.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed0a7cb700 1 --2- 172.21.15.115:0/3393792289 >> v2:172.21.15.156:3300/0 conn(0x7fed0409a050 0x7fed0414b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed08fc8700 1 -- 172.21.15.115:0/3393792289 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093986006 0 0) 0x7fed040a4550 con 0x7fed04135b90 2023-09-29T23:05:07.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed08fc8700 1 -- 172.21.15.115:0/3393792289 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf0003570 con 0x7fed04135b90 2023-09-29T23:05:07.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed08fc8700 1 -- 172.21.15.115:0/3393792289 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648204927 0 0) 0x7fed04099870 con 0x7fed04135f60 2023-09-29T23:05:07.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed08fc8700 1 -- 172.21.15.115:0/3393792289 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed040a4550 con 0x7fed04135f60 2023-09-29T23:05:07.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed0a7cb700 1 -- 172.21.15.115:0/3393792289 >> v1:172.21.15.156:6789/0 conn(0x7fed04135f60 legacy=0x7fed0409dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed0a7cb700 1 -- 172.21.15.115:0/3393792289 >> v1:172.21.15.115:6789/0 conn(0x7fed04135b90 legacy=0x7fed040a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.965+0000 7fed0a7cb700 1 -- 172.21.15.115:0/3393792289 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed040a4290 con 0x7fed0409a050 2023-09-29T23:05:07.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0a7cb700 1 --2- 172.21.15.115:0/3393792289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed0409a050 0x7fed0414b400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed040a4480 tx=0x7fecfc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d87ed09579723a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:07.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed08fc8700 1 -- 172.21.15.115:0/3393792289 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc011630 con 0x7fed0409a050 2023-09-29T23:05:07.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed08fc8700 1 -- 172.21.15.115:0/3393792289 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc011790 con 0x7fed0409a050 2023-09-29T23:05:07.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed08fc8700 1 -- 172.21.15.115:0/3393792289 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc011b50 con 0x7fed0409a050 2023-09-29T23:05:07.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 -- 172.21.15.115:0/3393792289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed0409a050 msgr2=0x7fed0414b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 --2- 172.21.15.115:0/3393792289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed0409a050 0x7fed0414b400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed040a4480 tx=0x7fecfc0091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 -- 172.21.15.115:0/3393792289 shutdown_connections 2023-09-29T23:05:07.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 --2- 172.21.15.115:0/3393792289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed0409a050 0x7fed0414b400 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 -- 172.21.15.115:0/3393792289 >> 172.21.15.115:0/3393792289 conn(0x7fed040b1d20 msgr2=0x7fed040b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:07.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 -- 172.21.15.115:0/3393792289 shutdown_connections 2023-09-29T23:05:07.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 -- 172.21.15.115:0/3393792289 wait complete. 2023-09-29T23:05:07.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 Processor -- start 2023-09-29T23:05:07.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 -- start start 2023-09-29T23:05:07.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0409a050 0x7fed0409b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed04135b90 0x7fed04152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed04135f60 0x7fed04152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed041337c0 con 0x7fed04135b90 2023-09-29T23:05:07.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed041534e0 con 0x7fed04135f60 2023-09-29T23:05:07.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0afcc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed041537a0 con 0x7fed0409a050 2023-09-29T23:05:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed097c9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed04135b90 0x7fed04152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed09fca700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0409a050 0x7fed0409b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed097c9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed04135b90 0x7fed04152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40796/0 (socket says 172.21.15.115:40796) 2023-09-29T23:05:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed097c9700 1 -- 172.21.15.115:0/645990154 learned_addr learned my addr 172.21.15.115:0/645990154 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed0a7cb700 1 --2- 172.21.15.115:0/645990154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed04135f60 0x7fed04152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed097c9700 1 -- 172.21.15.115:0/645990154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0409a050 msgr2=0x7fed0409b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed097c9700 1 --2- 172.21.15.115:0/645990154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0409a050 0x7fed0409b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed097c9700 1 -- 172.21.15.115:0/645990154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed04135f60 msgr2=0x7fed04152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed097c9700 1 --2- 172.21.15.115:0/645990154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed04135f60 0x7fed04152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed097c9700 1 -- 172.21.15.115:0/645990154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc009420 con 0x7fed04135b90 2023-09-29T23:05:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.969+0000 7fed097c9700 1 --2- 172.21.15.115:0/645990154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed04135b90 0x7fed04152930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed0000cb40 tx=0x7fed000027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:07.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.973+0000 7fecf9ffb700 1 -- 172.21.15.115:0/645990154 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed000040f0 con 0x7fed04135b90 2023-09-29T23:05:07.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.973+0000 7fecf9ffb700 1 -- 172.21.15.115:0/645990154 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0000a7e0 con 0x7fed04135b90 2023-09-29T23:05:07.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.973+0000 7fed0afcc700 1 -- 172.21.15.115:0/645990154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed04133160 con 0x7fed04135b90 2023-09-29T23:05:07.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.973+0000 7fecf9ffb700 1 -- 172.21.15.115:0/645990154 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0000aba0 con 0x7fed04135b90 2023-09-29T23:05:07.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.973+0000 7fed0afcc700 1 -- 172.21.15.115:0/645990154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0409bb00 con 0x7fed04135b90 2023-09-29T23:05:07.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.973+0000 7fed0afcc700 1 -- 172.21.15.115:0/645990154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0404be00 con 0x7fed04135b90 2023-09-29T23:05:07.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.977+0000 7fecf9ffb700 1 -- 172.21.15.115:0/645990154 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fed00012420 con 0x7fed04135b90 2023-09-29T23:05:07.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.977+0000 7fecf9ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:07.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.977+0000 7fecf9ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:07.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.977+0000 7fecf9ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:07.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.977+0000 7fecf9ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:07.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.977+0000 7fecf9ffb700 1 --2- 172.21.15.115:0/645990154 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fece808e8b0 0x7fece8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:07.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.977+0000 7fecf9ffb700 1 -- 172.21.15.115:0/645990154 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fed000b47c0 con 0x7fed04135b90 2023-09-29T23:05:07.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.977+0000 7fed09fca700 1 --2- 172.21.15.115:0/645990154 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fece808e8b0 0x7fece8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:07.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.977+0000 7fed09fca700 1 --2- 172.21.15.115:0/645990154 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fece808e8b0 0x7fece8090d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fecf4007fd0 tx=0x7fecf4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:07.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:07.985+0000 7fecf9ffb700 1 -- 172.21.15.115:0/645990154 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fed000851f0 con 0x7fed04135b90 2023-09-29T23:05:08.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fed0afcc700 1 -- 172.21.15.115:0/645990154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fed040a3d10 con 0x7fed04135b90 2023-09-29T23:05:08.202 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fecf9ffb700 1 -- 172.21.15.115:0/645990154 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1298 (secure 0 0 0) 0x7fed00088810 con 0x7fed04135b90 2023-09-29T23:05:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:08.203 INFO:teuthology.orchestra.run.smithi115.stdout:{"fsid":"593687ae-01c7-4a32-a91e-931db75fb751","health":{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":19,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":4,"num_up_osds":4,"osd_up_since":1696028693,"num_in_osds":4,"osd_in_since":1696028690,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":30},{"state_name":"creating+activating","count":10},{"state_name":"active","count":1}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":3262595072,"bytes_avail":380530065408,"bytes_total":383792660480,"inactive_pgs_ratio":0.70476192235946655},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4248}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":2,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-09-29T23:04:48.578113+0000","services":{}},"progress_events":{}} 2023-09-29T23:05:08.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fed0afcc700 10 mgrc shutdown 2023-09-29T23:05:08.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fed0afcc700 1 -- 172.21.15.115:0/645990154 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fece808e8b0 msgr2=0x7fece8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:08.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fed0afcc700 1 --2- 172.21.15.115:0/645990154 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fece808e8b0 0x7fece8090d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fecf4007fd0 tx=0x7fecf4009040 comp rx=0 tx=0).stop 2023-09-29T23:05:08.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fed0afcc700 1 -- 172.21.15.115:0/645990154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed04135b90 msgr2=0x7fed04152930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:08.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fed0afcc700 1 --2- 172.21.15.115:0/645990154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed04135b90 0x7fed04152930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed0000cb40 tx=0x7fed000027a0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fed0afcc700 1 -- 172.21.15.115:0/645990154 shutdown_connections 2023-09-29T23:05:08.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fed0afcc700 1 --2- 172.21.15.115:0/645990154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fed04135f60 0x7fed04152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fed0afcc700 1 --2- 172.21.15.115:0/645990154 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fece808e8b0 0x7fece8090d60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fed0afcc700 1 --2- 172.21.15.115:0/645990154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed04135b90 0x7fed04152930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fed0afcc700 1 --2- 172.21.15.115:0/645990154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fed0409a050 0x7fed0409b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fed0afcc700 1 -- 172.21.15.115:0/645990154 >> 172.21.15.115:0/645990154 conn(0x7fed040b1d20 msgr2=0x7fed04069260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:08.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.201+0000 7fed0afcc700 1 -- 172.21.15.115:0/645990154 shutdown_connections 2023-09-29T23:05:08.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.205+0000 7fed0afcc700 1 -- 172.21.15.115:0/645990154 wait complete. 2023-09-29T23:05:08.217 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-29T23:05:08.217 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:05:08.256 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:05:08.259 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:05:08.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.313+0000 7f4155181700 1 Processor -- start 2023-09-29T23:05:08.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.313+0000 7f4155181700 1 -- start start 2023-09-29T23:05:08.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4155181700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 0x7f41500a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:08.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4155181700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f415006ef70 0x7f4150143270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:08.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4155181700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41500a4830 con 0x7f41500a4370 2023-09-29T23:05:08.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4155181700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4150067f30 con 0x7f415006ef70 2023-09-29T23:05:08.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4155181700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415006fa30 con 0x7f4150067b60 2023-09-29T23:05:08.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f414ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 0x7f41500a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:08.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4154980700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f415006ef70 0x7f4150143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:08.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f414ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 0x7f41500a3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33148/0 (socket says 172.21.15.115:33148) 2023-09-29T23:05:08.319 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f414ffff700 1 -- 172.21.15.115:0/4231323790 learned_addr learned my addr 172.21.15.115:0/4231323790 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:08.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f414ffff700 1 -- 172.21.15.115:0/4231323790 >> v2:172.21.15.115:3300/0 conn(0x7f415006ef70 msgr2=0x7f4150143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:08.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f414ffff700 1 --2- 172.21.15.115:0/4231323790 >> v2:172.21.15.115:3300/0 conn(0x7f415006ef70 0x7f4150143270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f414ffff700 1 -- 172.21.15.115:0/4231323790 >> v1:172.21.15.156:6789/0 conn(0x7f41500a4370 legacy=0x7f415006e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:08.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f414ffff700 1 -- 172.21.15.115:0/4231323790 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415006e410 con 0x7f4150067b60 2023-09-29T23:05:08.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f414ffff700 1 --2- 172.21.15.115:0/4231323790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 0x7f41500a3e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f41380099b0 tx=0x7f4138009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51a412290eb99531 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:08.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f414effd700 1 -- 172.21.15.115:0/4231323790 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138009ea0 con 0x7f4150067b60 2023-09-29T23:05:08.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f414effd700 1 -- 172.21.15.115:0/4231323790 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413800b860 con 0x7f4150067b60 2023-09-29T23:05:08.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f414effd700 1 -- 172.21.15.115:0/4231323790 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413800bc00 con 0x7f4150067b60 2023-09-29T23:05:08.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4155181700 1 -- 172.21.15.115:0/4231323790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 msgr2=0x7f41500a3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:08.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4155181700 1 --2- 172.21.15.115:0/4231323790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 0x7f41500a3e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f41380099b0 tx=0x7f4138009250 comp rx=0 tx=0).stop 2023-09-29T23:05:08.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4155181700 1 -- 172.21.15.115:0/4231323790 shutdown_connections 2023-09-29T23:05:08.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4155181700 1 --2- 172.21.15.115:0/4231323790 >> v2:172.21.15.115:3300/0 conn(0x7f415006ef70 0x7f4150143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4155181700 1 --2- 172.21.15.115:0/4231323790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 0x7f41500a3e30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4155181700 1 -- 172.21.15.115:0/4231323790 >> 172.21.15.115:0/4231323790 conn(0x7f4150068a40 msgr2=0x7f4150068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:08.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4155181700 1 -- 172.21.15.115:0/4231323790 shutdown_connections 2023-09-29T23:05:08.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.317+0000 7f4155181700 1 -- 172.21.15.115:0/4231323790 wait complete. 2023-09-29T23:05:08.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4155181700 1 Processor -- start 2023-09-29T23:05:08.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4155181700 1 -- start start 2023-09-29T23:05:08.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4155181700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 0x7f415009cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:08.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4155181700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f415006ef70 0x7f415009b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:08.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4155181700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41500a4370 0x7f415009b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:08.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4155181700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415009d2e0 con 0x7f41500a4370 2023-09-29T23:05:08.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4155181700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415009c570 con 0x7f415006ef70 2023-09-29T23:05:08.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4155181700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415009bc40 con 0x7f4150067b60 2023-09-29T23:05:08.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f414ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 0x7f415009cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:08.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f414ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 0x7f415009cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33158/0 (socket says 172.21.15.115:33158) 2023-09-29T23:05:08.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f414ffff700 1 -- 172.21.15.115:0/1439702811 learned_addr learned my addr 172.21.15.115:0/1439702811 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:08.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4154980700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41500a4370 0x7f415009b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:08.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f414f7fe700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f415006ef70 0x7f415009b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:08.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f414ffff700 1 -- 172.21.15.115:0/1439702811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f415006ef70 msgr2=0x7f415009b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:08.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f414ffff700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f415006ef70 0x7f415009b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f414ffff700 1 -- 172.21.15.115:0/1439702811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41500a4370 msgr2=0x7f415009b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:08.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f414ffff700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41500a4370 0x7f415009b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f414ffff700 1 -- 172.21.15.115:0/1439702811 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41380094f0 con 0x7f4150067b60 2023-09-29T23:05:08.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4154980700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41500a4370 0x7f415009b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:08.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f414ffff700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 0x7f415009cbe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4150068150 tx=0x7f4138017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:08.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4147fff700 1 -- 172.21.15.115:0/1439702811 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138000d10 con 0x7f4150067b60 2023-09-29T23:05:08.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4147fff700 1 -- 172.21.15.115:0/1439702811 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413800bbe0 con 0x7f4150067b60 2023-09-29T23:05:08.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4155181700 1 -- 172.21.15.115:0/1439702811 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415009bf00 con 0x7f4150067b60 2023-09-29T23:05:08.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4147fff700 1 -- 172.21.15.115:0/1439702811 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138011670 con 0x7f4150067b60 2023-09-29T23:05:08.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.321+0000 7f4155181700 1 -- 172.21.15.115:0/1439702811 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41500b10f0 con 0x7f4150067b60 2023-09-29T23:05:08.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.325+0000 7f4155181700 1 -- 172.21.15.115:0/1439702811 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415004be00 con 0x7f4150067b60 2023-09-29T23:05:08.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.325+0000 7f4147fff700 1 -- 172.21.15.115:0/1439702811 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f4138011aa0 con 0x7f4150067b60 2023-09-29T23:05:08.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.325+0000 7f4147fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:08.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.325+0000 7f4147fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:08.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.325+0000 7f4147fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:08.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.325+0000 7f4147fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:08.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.325+0000 7f4147fff700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f413008e8b0 0x7f4130090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:08.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.329+0000 7f4147fff700 1 -- 172.21.15.115:0/1439702811 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f41380b5fe0 con 0x7f4150067b60 2023-09-29T23:05:08.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.329+0000 7f414f7fe700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f413008e8b0 0x7f4130090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:08.330 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.329+0000 7f414f7fe700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f413008e8b0 0x7f4130090d60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f41500a2960 tx=0x7f4140009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:08.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.337+0000 7f4147fff700 1 -- 172.21.15.115:0/1439702811 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4138086a20 con 0x7f4150067b60 2023-09-29T23:05:08.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.497+0000 7f4155181700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-29T23:05:08.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.497+0000 7f4155181700 1 -- 172.21.15.115:0/1439702811 --> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41501437b0 con 0x7f413008e8b0 2023-09-29T23:05:08.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.509+0000 7f4147fff700 1 -- 172.21.15.115:0/1439702811 <== mgr.4107 v2:172.21.15.156:6824/26644 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263179 (secure 0 0 0) 0x7f41501437b0 con 0x7f413008e8b0 2023-09-29T23:05:08.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.509+0000 7f4147fff700 20 mgrc handle_command_reply tid 0 r 0 2023-09-29T23:05:08.516 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:08.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.517+0000 7f4155181700 10 mgrc shutdown 2023-09-29T23:05:08.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.517+0000 7f4155181700 1 -- 172.21.15.115:0/1439702811 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f413008e8b0 msgr2=0x7f4130090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:08.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.517+0000 7f4155181700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f413008e8b0 0x7f4130090d60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f41500a2960 tx=0x7f4140009040 comp rx=0 tx=0).stop 2023-09-29T23:05:08.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.517+0000 7f4155181700 1 -- 172.21.15.115:0/1439702811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 msgr2=0x7f415009cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:08.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.517+0000 7f4155181700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 0x7f415009cbe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4150068150 tx=0x7f4138017000 comp rx=0 tx=0).stop 2023-09-29T23:05:08.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.517+0000 7f4155181700 1 -- 172.21.15.115:0/1439702811 shutdown_connections 2023-09-29T23:05:08.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.517+0000 7f4155181700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f413008e8b0 0x7f4130090d60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.517+0000 7f4155181700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41500a4370 0x7f415009b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.517+0000 7f4155181700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f415006ef70 0x7f415009b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.517+0000 7f4155181700 1 --2- 172.21.15.115:0/1439702811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4150067b60 0x7f415009cbe0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:08.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.517+0000 7f4155181700 1 -- 172.21.15.115:0/1439702811 >> 172.21.15.115:0/1439702811 conn(0x7f4150068a40 msgr2=0x7f4150134de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:08.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.517+0000 7f4155181700 1 -- 172.21.15.115:0/1439702811 shutdown_connections 2023-09-29T23:05:08.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:08.517+0000 7f4155181700 1 -- 172.21.15.115:0/1439702811 wait complete. 2023-09-29T23:05:08.519 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-09-29T23:05:08.531 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-09-29T23:05:06.838917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":374797520,"kb_used":3186128,"kb_used_data":371611712,"kb_used_omap":411,"kb_used_meta":0,"kb_avail":371611392,"statfs":{"total":383792660480,"available":380530065408,"internally_reserved":327680,"allocated":380530393088,"data_stored":380530393088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":421004,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":38,"commit_latency_ns":0,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.016922"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.847662+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:08.282524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851614+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:02:45.413482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851733+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:00:59.236159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.855729+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:18:29.699338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848212+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:32.935665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849677+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:36:15.669365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.855865+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:44:09.433237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850208+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:12:54.806149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845935+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:23:08.165955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854400+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:18.681401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852032+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:31:53.623960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845938+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:45:19.820523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845307+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:43:42.473330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850142+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:27:03.221776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850370+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:04:36.437126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849281+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:17.918744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854525+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:03.578342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850342+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:27:58.793491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846337+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:07:57.307417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854802+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:33:35.631951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846830+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:50:45.952748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854277+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:02:48.471581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.853990+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:08:59.954277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848560+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:42:07.158440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.853767+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:33:00.710798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852737+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:46:23.962799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851165+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:28.548035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.853518+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:29:45.889254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848629+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:53.841175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850688+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:34:48.714874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851975+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:44:09.407881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846528+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:03:01.571565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852969+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:51:24.073380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.860892+0000","last_change":"2023-09-29T23:05:03.861608+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.860892+0000","last_undegraded":"2023-09-29T23:05:03.860892+0000","last_fullsized":"2023-09-29T23:05:03.860892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850896+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:42:01.814209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.840810+0000","last_change":"2023-09-29T23:05:03.841192+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.840810+0000","last_undegraded":"2023-09-29T23:05:03.840810+0000","last_fullsized":"2023-09-29T23:05:03.840810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.855304+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:46:44.253356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.841828+0000","last_change":"2023-09-29T23:05:03.842249+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.841828+0000","last_undegraded":"2023-09-29T23:05:03.841828+0000","last_fullsized":"2023-09-29T23:05:03.841828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:27:57.781735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849989+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:38.742119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.849842+0000","last_change":"2023-09-29T23:05:03.849842+0000","last_active":"2023-09-29T23:05:03.849842+0000","last_peered":"2023-09-29T23:05:03.849842+0000","last_clean":"2023-09-29T23:05:03.849842+0000","last_became_active":"2023-09-29T23:05:03.849529+0000","last_became_peered":"2023-09-29T23:05:03.849529+0000","last_unstale":"2023-09-29T23:05:03.849842+0000","last_undegraded":"2023-09-29T23:05:03.849842+0000","last_fullsized":"2023-09-29T23:05:03.849842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.853590+0000","last_change":"2023-09-29T23:05:03.853590+0000","last_active":"2023-09-29T23:05:03.853590+0000","last_peered":"2023-09-29T23:05:03.853590+0000","last_clean":"2023-09-29T23:05:03.853590+0000","last_became_active":"2023-09-29T23:05:03.853335+0000","last_became_peered":"2023-09-29T23:05:03.853335+0000","last_unstale":"2023-09-29T23:05:03.853590+0000","last_undegraded":"2023-09-29T23:05:03.853590+0000","last_fullsized":"2023-09-29T23:05:03.853590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:57:20.234700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851633+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:22:14.141803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.853815+0000","last_change":"2023-09-29T23:05:03.853815+0000","last_active":"2023-09-29T23:05:03.853815+0000","last_peered":"2023-09-29T23:05:03.853815+0000","last_clean":"2023-09-29T23:05:03.853815+0000","last_became_active":"2023-09-29T23:05:03.853456+0000","last_became_peered":"2023-09-29T23:05:03.853456+0000","last_unstale":"2023-09-29T23:05:03.853815+0000","last_undegraded":"2023-09-29T23:05:03.853815+0000","last_fullsized":"2023-09-29T23:05:03.853815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848355+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:28:39.908387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.844642+0000","last_change":"2023-09-29T23:05:03.846600+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.844642+0000","last_undegraded":"2023-09-29T23:05:03.844642+0000","last_fullsized":"2023-09-29T23:05:03.844642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:37.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848753+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:57:25.282750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.844114+0000","last_change":"2023-09-29T23:05:03.844675+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.844114+0000","last_undegraded":"2023-09-29T23:05:03.844114+0000","last_fullsized":"2023-09-29T23:05:03.844114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:52.829419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.843763+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:41:32.696950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.879324+0000","last_change":"2023-09-29T23:05:03.879324+0000","last_active":"2023-09-29T23:05:03.879324+0000","last_peered":"2023-09-29T23:05:03.879324+0000","last_clean":"2023-09-29T23:05:03.879324+0000","last_became_active":"2023-09-29T23:05:03.874684+0000","last_became_peered":"2023-09-29T23:05:03.874684+0000","last_unstale":"2023-09-29T23:05:03.879324+0000","last_undegraded":"2023-09-29T23:05:03.879324+0000","last_fullsized":"2023-09-29T23:05:03.879324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:07:10.402882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851535+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:08:19.473130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.851543+0000","last_change":"2023-09-29T23:05:03.851543+0000","last_active":"2023-09-29T23:05:03.851543+0000","last_peered":"2023-09-29T23:05:03.851543+0000","last_clean":"2023-09-29T23:05:03.851543+0000","last_became_active":"2023-09-29T23:05:03.849728+0000","last_became_peered":"2023-09-29T23:05:03.849728+0000","last_unstale":"2023-09-29T23:05:03.851543+0000","last_undegraded":"2023-09-29T23:05:03.851543+0000","last_fullsized":"2023-09-29T23:05:03.851543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.850615+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:08:43.654146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.873312+0000","last_change":"2023-09-29T23:05:03.873312+0000","last_active":"2023-09-29T23:05:03.873312+0000","last_peered":"2023-09-29T23:05:03.873312+0000","last_clean":"2023-09-29T23:05:03.873312+0000","last_became_active":"2023-09-29T23:05:03.867491+0000","last_became_peered":"2023-09-29T23:05:03.867491+0000","last_unstale":"2023-09-29T23:05:03.873312+0000","last_undegraded":"2023-09-29T23:05:03.873312+0000","last_fullsized":"2023-09-29T23:05:03.873312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:21:38.208894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.843629+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:25.767254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.878136+0000","last_change":"2023-09-29T23:05:03.878136+0000","last_active":"2023-09-29T23:05:03.878136+0000","last_peered":"2023-09-29T23:05:03.878136+0000","last_clean":"2023-09-29T23:05:03.878136+0000","last_became_active":"2023-09-29T23:05:03.872575+0000","last_became_peered":"2023-09-29T23:05:03.872575+0000","last_unstale":"2023-09-29T23:05:03.878136+0000","last_undegraded":"2023-09-29T23:05:03.878136+0000","last_fullsized":"2023-09-29T23:05:03.878136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:18:45.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849714+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:47:02.919688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822229+0000","last_change":"2023-09-29T23:04:56.664338+0000","last_active":"2023-09-29T23:05:02.822229+0000","last_peered":"2023-09-29T23:05:02.822229+0000","last_clean":"2023-09-29T23:05:02.822229+0000","last_became_active":"2023-09-29T23:04:56.663441+0000","last_became_peered":"2023-09-29T23:04:56.663441+0000","last_unstale":"2023-09-29T23:05:02.822229+0000","last_undegraded":"2023-09-29T23:05:02.822229+0000","last_fullsized":"2023-09-29T23:05:02.822229+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_clean_scrub_stamp":"2023-09-29T23:04:55.640704+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:54:28.112724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.825047+0000","last_change":"2023-09-29T23:04:59.797078+0000","last_active":"2023-09-29T23:05:02.825047+0000","last_peered":"2023-09-29T23:05:02.825047+0000","last_clean":"2023-09-29T23:05:02.825047+0000","last_became_active":"2023-09-29T23:04:59.795998+0000","last_became_peered":"2023-09-29T23:04:59.795998+0000","last_unstale":"2023-09-29T23:05:02.825047+0000","last_undegraded":"2023-09-29T23:05:02.825047+0000","last_fullsized":"2023-09-29T23:05:02.825047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.861050+0000","last_change":"2023-09-29T23:05:03.861201+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.861050+0000","last_undegraded":"2023-09-29T23:05:03.861050+0000","last_fullsized":"2023-09-29T23:05:03.861050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:56:45.933376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849867+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:11:05.030356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822981+0000","last_change":"2023-09-29T23:04:59.798054+0000","last_active":"2023-09-29T23:05:02.822981+0000","last_peered":"2023-09-29T23:05:02.822981+0000","last_clean":"2023-09-29T23:05:02.822981+0000","last_became_active":"2023-09-29T23:04:59.797489+0000","last_became_peered":"2023-09-29T23:04:59.797489+0000","last_unstale":"2023-09-29T23:05:02.822981+0000","last_undegraded":"2023-09-29T23:05:02.822981+0000","last_fullsized":"2023-09-29T23:05:02.822981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:32:42.777486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.851676+0000","last_change":"2023-09-29T23:05:03.851676+0000","last_active":"2023-09-29T23:05:03.851676+0000","last_peered":"2023-09-29T23:05:03.851676+0000","last_clean":"2023-09-29T23:05:03.851676+0000","last_became_active":"2023-09-29T23:05:03.851368+0000","last_became_peered":"2023-09-29T23:05:03.851368+0000","last_unstale":"2023-09-29T23:05:03.851676+0000","last_undegraded":"2023-09-29T23:05:03.851676+0000","last_fullsized":"2023-09-29T23:05:03.851676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:43:41.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.854744+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:50:01.256063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.823215+0000","last_change":"2023-09-29T23:04:59.951828+0000","last_active":"2023-09-29T23:05:02.823215+0000","last_peered":"2023-09-29T23:05:02.823215+0000","last_clean":"2023-09-29T23:05:02.823215+0000","last_became_active":"2023-09-29T23:04:59.951181+0000","last_became_peered":"2023-09-29T23:04:59.951181+0000","last_unstale":"2023-09-29T23:05:02.823215+0000","last_undegraded":"2023-09-29T23:05:02.823215+0000","last_fullsized":"2023-09-29T23:05:02.823215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.847255+0000","last_change":"2023-09-29T23:05:03.847255+0000","last_active":"2023-09-29T23:05:03.847255+0000","last_peered":"2023-09-29T23:05:03.847255+0000","last_clean":"2023-09-29T23:05:03.847255+0000","last_became_active":"2023-09-29T23:05:03.846967+0000","last_became_peered":"2023-09-29T23:05:03.846967+0000","last_unstale":"2023-09-29T23:05:03.847255+0000","last_undegraded":"2023-09-29T23:05:03.847255+0000","last_fullsized":"2023-09-29T23:05:03.847255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:41:31.685195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848434+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:44:09.433237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.825640+0000","last_change":"2023-09-29T23:04:59.797795+0000","last_active":"2023-09-29T23:05:02.825640+0000","last_peered":"2023-09-29T23:05:02.825640+0000","last_clean":"2023-09-29T23:05:02.825640+0000","last_became_active":"2023-09-29T23:04:59.796512+0000","last_became_peered":"2023-09-29T23:04:59.796512+0000","last_unstale":"2023-09-29T23:05:02.825640+0000","last_undegraded":"2023-09-29T23:05:02.825640+0000","last_fullsized":"2023-09-29T23:05:02.825640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.848672+0000","last_change":"2023-09-29T23:05:03.848672+0000","last_active":"2023-09-29T23:05:03.848672+0000","last_peered":"2023-09-29T23:05:03.848672+0000","last_clean":"2023-09-29T23:05:03.848672+0000","last_became_active":"2023-09-29T23:05:03.848507+0000","last_became_peered":"2023-09-29T23:05:03.848507+0000","last_unstale":"2023-09-29T23:05:03.848672+0000","last_undegraded":"2023-09-29T23:05:03.848672+0000","last_fullsized":"2023-09-29T23:05:03.848672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:19:37.297844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848355+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:46:40.708391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.844413+0000","last_change":"2023-09-29T23:05:03.845055+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.844413+0000","last_undegraded":"2023-09-29T23:05:03.844413+0000","last_fullsized":"2023-09-29T23:05:03.844413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:28:17.915992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822652+0000","last_change":"2023-09-29T23:04:59.952454+0000","last_active":"2023-09-29T23:05:02.822652+0000","last_peered":"2023-09-29T23:05:02.822652+0000","last_clean":"2023-09-29T23:05:02.822652+0000","last_became_active":"2023-09-29T23:04:59.951496+0000","last_became_peered":"2023-09-29T23:04:59.951496+0000","last_unstale":"2023-09-29T23:05:02.822652+0000","last_undegraded":"2023-09-29T23:05:02.822652+0000","last_fullsized":"2023-09-29T23:05:02.822652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.847097+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:50:01.256063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.855922+0000","last_change":"2023-09-29T23:05:03.855922+0000","last_active":"2023-09-29T23:05:03.855922+0000","last_peered":"2023-09-29T23:05:03.855922+0000","last_clean":"2023-09-29T23:05:03.855922+0000","last_became_active":"2023-09-29T23:05:03.851814+0000","last_became_peered":"2023-09-29T23:05:03.851814+0000","last_unstale":"2023-09-29T23:05:03.855922+0000","last_undegraded":"2023-09-29T23:05:03.855922+0000","last_fullsized":"2023-09-29T23:05:03.855922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:29:31.409379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.826355+0000","last_change":"2023-09-29T23:04:59.798170+0000","last_active":"2023-09-29T23:05:02.826355+0000","last_peered":"2023-09-29T23:05:02.826355+0000","last_clean":"2023-09-29T23:05:02.826355+0000","last_became_active":"2023-09-29T23:04:59.797758+0000","last_became_peered":"2023-09-29T23:04:59.797758+0000","last_unstale":"2023-09-29T23:05:02.826355+0000","last_undegraded":"2023-09-29T23:05:02.826355+0000","last_fullsized":"2023-09-29T23:05:02.826355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:23.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845914+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:32:47.567597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":7,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.879328+0000","last_change":"2023-09-29T23:05:03.879418+0000","last_active":"2023-09-29T23:05:03.879328+0000","last_peered":"2023-09-29T23:05:03.879328+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"2023-09-29T23:05:03.875943+0000","last_became_peered":"2023-09-29T23:05:03.875943+0000","last_unstale":"2023-09-29T23:05:03.879328+0000","last_undegraded":"2023-09-29T23:05:03.879328+0000","last_fullsized":"2023-09-29T23:05:03.879328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:22:16.497716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.822477+0000","last_change":"2023-09-29T23:04:59.794782+0000","last_active":"2023-09-29T23:05:02.822477+0000","last_peered":"2023-09-29T23:05:02.822477+0000","last_clean":"2023-09-29T23:05:02.822477+0000","last_became_active":"2023-09-29T23:04:59.794073+0000","last_became_peered":"2023-09-29T23:04:59.794073+0000","last_unstale":"2023-09-29T23:05:02.822477+0000","last_undegraded":"2023-09-29T23:05:02.822477+0000","last_fullsized":"2023-09-29T23:05:02.822477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:44:24.462680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846593+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:47.915370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.851188+0000","last_change":"2023-09-29T23:05:03.851188+0000","last_active":"2023-09-29T23:05:03.851188+0000","last_peered":"2023-09-29T23:05:03.851188+0000","last_clean":"2023-09-29T23:05:03.851188+0000","last_became_active":"2023-09-29T23:05:03.850904+0000","last_became_peered":"2023-09-29T23:05:03.850904+0000","last_unstale":"2023-09-29T23:05:03.851188+0000","last_undegraded":"2023-09-29T23:05:03.851188+0000","last_fullsized":"2023-09-29T23:05:03.851188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:24.755498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:05:02.826148+0000","last_change":"2023-09-29T23:04:59.799021+0000","last_active":"2023-09-29T23:05:02.826148+0000","last_peered":"2023-09-29T23:05:02.826148+0000","last_clean":"2023-09-29T23:05:02.826148+0000","last_became_active":"2023-09-29T23:04:59.797145+0000","last_became_peered":"2023-09-29T23:04:59.797145+0000","last_unstale":"2023-09-29T23:05:02.826148+0000","last_undegraded":"2023-09-29T23:05:02.826148+0000","last_fullsized":"2023-09-29T23:05:02.826148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:46:55.987895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.843218+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:15:37.246780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.844309+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:22:17.509472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.853192+0000","last_change":"2023-09-29T23:05:03.853192+0000","last_active":"2023-09-29T23:05:03.853192+0000","last_peered":"2023-09-29T23:05:03.853192+0000","last_clean":"2023-09-29T23:05:03.853192+0000","last_became_active":"2023-09-29T23:05:03.852382+0000","last_became_peered":"2023-09-29T23:05:03.852382+0000","last_unstale":"2023-09-29T23:05:03.853192+0000","last_undegraded":"2023-09-29T23:05:03.853192+0000","last_fullsized":"2023-09-29T23:05:03.853192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:49:53.513521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849855+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:46:44.253356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":7,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.859461+0000","last_change":"2023-09-29T23:05:03.859535+0000","last_active":"2023-09-29T23:05:03.859461+0000","last_peered":"2023-09-29T23:05:03.859461+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"2023-09-29T23:05:03.858960+0000","last_became_peered":"2023-09-29T23:05:03.858960+0000","last_unstale":"2023-09-29T23:05:03.859461+0000","last_undegraded":"2023-09-29T23:05:03.859461+0000","last_fullsized":"2023-09-29T23:05:03.859461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.857165+0000","last_change":"2023-09-29T23:05:03.857165+0000","last_active":"2023-09-29T23:05:03.857165+0000","last_peered":"2023-09-29T23:05:03.857165+0000","last_clean":"2023-09-29T23:05:03.857165+0000","last_became_active":"2023-09-29T23:05:03.856861+0000","last_became_peered":"2023-09-29T23:05:03.856861+0000","last_unstale":"2023-09-29T23:05:03.857165+0000","last_undegraded":"2023-09-29T23:05:03.857165+0000","last_fullsized":"2023-09-29T23:05:03.857165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:36:14.657609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849733+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:28:18.927748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.856407+0000","last_change":"2023-09-29T23:05:03.856407+0000","last_active":"2023-09-29T23:05:03.856407+0000","last_peered":"2023-09-29T23:05:03.856407+0000","last_clean":"2023-09-29T23:05:03.856407+0000","last_became_active":"2023-09-29T23:05:03.855984+0000","last_became_peered":"2023-09-29T23:05:03.855984+0000","last_unstale":"2023-09-29T23:05:03.856407+0000","last_undegraded":"2023-09-29T23:05:03.856407+0000","last_fullsized":"2023-09-29T23:05:03.856407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:46:25.574473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.852141+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:32:47.567597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.846381+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:13.653906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":5,"reported_epoch":18,"state":"active","last_fresh":"2023-09-29T23:05:03.880964+0000","last_change":"2023-09-29T23:05:03.880964+0000","last_active":"2023-09-29T23:05:03.880964+0000","last_peered":"2023-09-29T23:05:03.880964+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"2023-09-29T23:05:03.880964+0000","last_became_peered":"2023-09-29T23:05:03.880964+0000","last_unstale":"2023-09-29T23:05:03.880964+0000","last_undegraded":"2023-09-29T23:05:03.880964+0000","last_fullsized":"2023-09-29T23:05:03.880964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:15:36.235024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849143+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:56.707907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.835998+0000","last_change":"2023-09-29T23:05:03.836362+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.835998+0000","last_undegraded":"2023-09-29T23:05:03.835998+0000","last_fullsized":"2023-09-29T23:05:03.835998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.851924+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:14:55.197436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.857474+0000","last_change":"2023-09-29T23:05:03.857474+0000","last_active":"2023-09-29T23:05:03.857474+0000","last_peered":"2023-09-29T23:05:03.857474+0000","last_clean":"2023-09-29T23:05:03.857474+0000","last_became_active":"2023-09-29T23:05:03.857167+0000","last_became_peered":"2023-09-29T23:05:03.857167+0000","last_unstale":"2023-09-29T23:05:03.857474+0000","last_undegraded":"2023-09-29T23:05:03.857474+0000","last_fullsized":"2023-09-29T23:05:03.857474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:31.923909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.845001+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:29:32.421135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.860723+0000","last_change":"2023-09-29T23:05:03.861113+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.860723+0000","last_undegraded":"2023-09-29T23:05:03.860723+0000","last_fullsized":"2023-09-29T23:05:03.860723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.844867+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:52:36.204606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":2,"reported_epoch":18,"state":"creating+activating","last_fresh":"2023-09-29T23:05:03.836312+0000","last_change":"2023-09-29T23:05:03.836671+0000","last_active":"2023-09-29T23:05:02.809230+0000","last_peered":"2023-09-29T23:05:02.809230+0000","last_clean":"2023-09-29T23:05:02.809230+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.836312+0000","last_undegraded":"2023-09-29T23:05:03.836312+0000","last_fullsized":"2023-09-29T23:05:03.836312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.849156+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:03:27.134395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.852972+0000","last_change":"2023-09-29T23:05:03.852972+0000","last_active":"2023-09-29T23:05:03.852972+0000","last_peered":"2023-09-29T23:05:03.852972+0000","last_clean":"2023-09-29T23:05:03.852972+0000","last_became_active":"2023-09-29T23:05:03.852482+0000","last_became_peered":"2023-09-29T23:05:03.852482+0000","last_unstale":"2023-09-29T23:05:03.852972+0000","last_undegraded":"2023-09-29T23:05:03.852972+0000","last_fullsized":"2023-09-29T23:05:03.852972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:00.205324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.848712+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:01.217080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.865954+0000","last_change":"2023-09-29T23:05:03.865954+0000","last_active":"2023-09-29T23:05:03.865954+0000","last_peered":"2023-09-29T23:05:03.865954+0000","last_clean":"2023-09-29T23:05:03.865954+0000","last_became_active":"2023-09-29T23:05:03.862839+0000","last_became_peered":"2023-09-29T23:05:03.862839+0000","last_unstale":"2023-09-29T23:05:03.865954+0000","last_undegraded":"2023-09-29T23:05:03.865954+0000","last_fullsized":"2023-09-29T23:05:03.865954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:51:59.213175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-29T23:05:03.820986+0000","last_change":"2023-09-29T23:05:03.842196+0000","last_active":"2023-09-29T23:05:03.820986+0000","last_peered":"2023-09-29T23:05:03.820986+0000","last_clean":"2023-09-29T23:05:03.820986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:05:03.820986+0000","last_undegraded":"2023-09-29T23:05:03.820986+0000","last_fullsized":"2023-09-29T23:05:03.820986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:07:06.833043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:05:03.850861+0000","last_change":"2023-09-29T23:05:03.850861+0000","last_active":"2023-09-29T23:05:03.850861+0000","last_peered":"2023-09-29T23:05:03.850861+0000","last_clean":"2023-09-29T23:05:03.850861+0000","last_became_active":"2023-09-29T23:05:03.848098+0000","last_became_peered":"2023-09-29T23:05:03.848098+0000","last_unstale":"2023-09-29T23:05:03.850861+0000","last_undegraded":"2023-09-29T23:05:03.850861+0000","last_fullsized":"2023-09-29T23:05:03.850861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795932,"kb_used_data":92903536,"kb_used_omap":62,"kb_used_meta":0,"kb_avail":92903448,"statfs":{"total":95948165120,"available":95133130752,"internally_reserved":90112,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63692,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":13,"commit_latency_ns":0,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797092,"kb_used_data":92902320,"kb_used_omap":124,"kb_used_meta":0,"kb_avail":92902288,"statfs":{"total":95948165120,"available":95131942912,"internally_reserved":32768,"allocated":95131975680,"data_stored":95131975680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":127133,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797140,"kb_used_data":92902320,"kb_used_omap":139,"kb_used_meta":0,"kb_avail":92902240,"statfs":{"total":95948165120,"available":95131893760,"internally_reserved":81920,"allocated":95131975680,"data_stored":95131975680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":142784,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":3,"commit_latency_ns":0,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795964,"kb_used_data":92903536,"kb_used_omap":85,"kb_used_meta":0,"kb_avail":92903416,"statfs":{"total":95948165120,"available":95133097984,"internally_reserved":122880,"allocated":95133220864,"data_stored":95133220864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87395,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":18,"commit_latency_ns":0,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]}],"pool_statfs":[]}} 2023-09-29T23:05:11.538 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:05:11.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e7fff700 1 Processor -- start 2023-09-29T23:05:11.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e7fff700 1 -- start start 2023-09-29T23:05:11.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa1e8068130 0x7fa1e814f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:11.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e7fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e80a3710 con 0x7fa1e80670a0 2023-09-29T23:05:11.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e7fff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e809bd40 con 0x7fa1e80a4140 2023-09-29T23:05:11.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e7fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e80a4510 con 0x7fa1e8068130 2023-09-29T23:05:11.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e67fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa1e80670a0 0x7fa1e8067a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41674/0 (socket says 172.21.15.115:41674) 2023-09-29T23:05:11.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e67fc700 1 -- 172.21.15.115:0/171472206 learned_addr learned my addr 172.21.15.115:0/171472206 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:11.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e77fe700 1 --2- 172.21.15.115:0/171472206 >> v2:172.21.15.115:3300/0 conn(0x7fa1e8068130 0x7fa1e814f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:11.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e5ffb700 1 -- 172.21.15.115:0/171472206 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032182897 0 0) 0x7fa1e80a3710 con 0x7fa1e80670a0 2023-09-29T23:05:11.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e5ffb700 1 -- 172.21.15.115:0/171472206 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1d4003570 con 0x7fa1e80670a0 2023-09-29T23:05:11.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e77fe700 1 -- 172.21.15.115:0/171472206 >> v1:172.21.15.156:6789/0 conn(0x7fa1e80a4140 legacy=0x7fa1e809d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:11.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e77fe700 1 -- 172.21.15.115:0/171472206 >> v1:172.21.15.115:6789/0 conn(0x7fa1e80670a0 legacy=0x7fa1e8067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:11.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e5ffb700 1 -- 172.21.15.115:0/171472206 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189908098 0 0) 0x7fa1e809bd40 con 0x7fa1e80a4140 2023-09-29T23:05:11.658 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e77fe700 1 -- 172.21.15.115:0/171472206 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e80686b0 con 0x7fa1e8068130 2023-09-29T23:05:11.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e77fe700 1 --2- 172.21.15.115:0/171472206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1e8068130 0x7fa1e814f7d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80098e0 tx=0x7fa1d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0de3cda79647b56 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:11.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e5ffb700 1 -- 172.21.15.115:0/171472206 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d800b6d0 con 0x7fa1e8068130 2023-09-29T23:05:11.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e5ffb700 1 -- 172.21.15.115:0/171472206 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d800b830 con 0x7fa1e8068130 2023-09-29T23:05:11.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e5ffb700 1 -- 172.21.15.115:0/171472206 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d800bbd0 con 0x7fa1e8068130 2023-09-29T23:05:11.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e7fff700 1 -- 172.21.15.115:0/171472206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1e8068130 msgr2=0x7fa1e814f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:11.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e7fff700 1 --2- 172.21.15.115:0/171472206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1e8068130 0x7fa1e814f7d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80098e0 tx=0x7fa1d80091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:11.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e7fff700 1 -- 172.21.15.115:0/171472206 shutdown_connections 2023-09-29T23:05:11.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e7fff700 1 --2- 172.21.15.115:0/171472206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1e8068130 0x7fa1e814f7d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:11.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e7fff700 1 -- 172.21.15.115:0/171472206 >> 172.21.15.115:0/171472206 conn(0x7fa1e80b1d20 msgr2=0x7fa1e80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:11.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e7fff700 1 -- 172.21.15.115:0/171472206 shutdown_connections 2023-09-29T23:05:11.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.653+0000 7fa1e7fff700 1 -- 172.21.15.115:0/171472206 wait complete. 2023-09-29T23:05:11.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.657+0000 7fa1e7fff700 1 Processor -- start 2023-09-29T23:05:11.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.657+0000 7fa1e7fff700 1 -- start start 2023-09-29T23:05:11.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.657+0000 7fa1e7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1e80670a0 0x7fa1e806e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:11.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.657+0000 7fa1e7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1e8068130 0x7fa1e8098690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:11.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.657+0000 7fa1e7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1e80a4140 0x7fa1e8147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:11.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.657+0000 7fa1e7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e8098bd0 con 0x7fa1e8068130 2023-09-29T23:05:11.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.657+0000 7fa1e7fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e8094a00 con 0x7fa1e80a4140 2023-09-29T23:05:11.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.657+0000 7fa1e7fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e8098d40 con 0x7fa1e80670a0 2023-09-29T23:05:11.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e6ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1e80670a0 0x7fa1e806e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:11.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e6ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1e80670a0 0x7fa1e806e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33160/0 (socket says 172.21.15.115:33160) 2023-09-29T23:05:11.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e6ffd700 1 -- 172.21.15.115:0/1945770270 learned_addr learned my addr 172.21.15.115:0/1945770270 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:11.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e67fc700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1e8068130 0x7fa1e8098690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:11.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e77fe700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1e80a4140 0x7fa1e8147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:11.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e6ffd700 1 -- 172.21.15.115:0/1945770270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1e80a4140 msgr2=0x7fa1e8147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:11.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e6ffd700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1e80a4140 0x7fa1e8147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:11.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e6ffd700 1 -- 172.21.15.115:0/1945770270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1e8068130 msgr2=0x7fa1e8098690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:11.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e6ffd700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1e8068130 0x7fa1e8098690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:11.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e6ffd700 1 -- 172.21.15.115:0/1945770270 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d8009420 con 0x7fa1e80670a0 2023-09-29T23:05:11.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e67fc700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1e8068130 0x7fa1e8098690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:11.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e6ffd700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1e80670a0 0x7fa1e806e8e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000c560 tx=0x7fa1d000c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:11.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1deffd700 1 -- 172.21.15.115:0/1945770270 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0011590 con 0x7fa1e80670a0 2023-09-29T23:05:11.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1deffd700 1 -- 172.21.15.115:0/1945770270 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d0011710 con 0x7fa1e80670a0 2023-09-29T23:05:11.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e7fff700 1 -- 172.21.15.115:0/1945770270 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e8094c30 con 0x7fa1e80670a0 2023-09-29T23:05:11.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1deffd700 1 -- 172.21.15.115:0/1945770270 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0011ad0 con 0x7fa1e80670a0 2023-09-29T23:05:11.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e7fff700 1 -- 172.21.15.115:0/1945770270 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e8148350 con 0x7fa1e80670a0 2023-09-29T23:05:11.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.661+0000 7fa1e7fff700 1 -- 172.21.15.115:0/1945770270 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e804be00 con 0x7fa1e80670a0 2023-09-29T23:05:11.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.665+0000 7fa1deffd700 1 -- 172.21.15.115:0/1945770270 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fa1d001b3b0 con 0x7fa1e80670a0 2023-09-29T23:05:11.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.665+0000 7fa1deffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:11.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.665+0000 7fa1deffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:11.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.665+0000 7fa1deffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:11.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.665+0000 7fa1deffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:11.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.665+0000 7fa1deffd700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa1c808e8b0 0x7fa1c8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:11.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.665+0000 7fa1deffd700 1 -- 172.21.15.115:0/1945770270 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fa1d00b40d0 con 0x7fa1e80670a0 2023-09-29T23:05:11.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.665+0000 7fa1e67fc700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa1c808e8b0 0x7fa1c8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:11.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.665+0000 7fa1e67fc700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa1c808e8b0 0x7fa1c8090d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80638d0 tx=0x7fa1e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:11.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.669+0000 7fa1deffd700 1 -- 172.21.15.115:0/1945770270 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa1d0084a60 con 0x7fa1e80670a0 2023-09-29T23:05:11.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.829+0000 7fa1e7fff700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-29T23:05:11.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.829+0000 7fa1e7fff700 1 -- 172.21.15.115:0/1945770270 --> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1e8148c90 con 0x7fa1c808e8b0 2023-09-29T23:05:11.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.841+0000 7fa1deffd700 1 -- 172.21.15.115:0/1945770270 <== mgr.4107 v2:172.21.15.156:6824/26644 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+266325 (secure 0 0 0) 0x7fa1e8148c90 con 0x7fa1c808e8b0 2023-09-29T23:05:11.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.841+0000 7fa1deffd700 20 mgrc handle_command_reply tid 0 r 0 2023-09-29T23:05:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:11.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.845+0000 7fa1e7fff700 10 mgrc shutdown 2023-09-29T23:05:11.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.845+0000 7fa1e7fff700 1 -- 172.21.15.115:0/1945770270 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa1c808e8b0 msgr2=0x7fa1c8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:11.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.845+0000 7fa1e7fff700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa1c808e8b0 0x7fa1c8090d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80638d0 tx=0x7fa1e0009040 comp rx=0 tx=0).stop 2023-09-29T23:05:11.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.845+0000 7fa1e7fff700 1 -- 172.21.15.115:0/1945770270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1e80670a0 msgr2=0x7fa1e806e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:11.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.845+0000 7fa1e7fff700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1e80670a0 0x7fa1e806e8e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000c560 tx=0x7fa1d000c870 comp rx=0 tx=0).stop 2023-09-29T23:05:11.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.845+0000 7fa1e7fff700 1 -- 172.21.15.115:0/1945770270 shutdown_connections 2023-09-29T23:05:11.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.845+0000 7fa1e7fff700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1e80a4140 0x7fa1e8147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:11.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.845+0000 7fa1e7fff700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa1c808e8b0 0x7fa1c8090d60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:11.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.845+0000 7fa1e7fff700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1e8068130 0x7fa1e8098690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:11.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.845+0000 7fa1e7fff700 1 --2- 172.21.15.115:0/1945770270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1e80670a0 0x7fa1e806e8e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:11.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.845+0000 7fa1e7fff700 1 -- 172.21.15.115:0/1945770270 >> 172.21.15.115:0/1945770270 conn(0x7fa1e80b1d20 msgr2=0x7fa1e80a25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:11.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.845+0000 7fa1e7fff700 1 -- 172.21.15.115:0/1945770270 shutdown_connections 2023-09-29T23:05:11.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.845+0000 7fa1e7fff700 1 -- 172.21.15.115:0/1945770270 wait complete. 2023-09-29T23:05:11.851 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-09-29T23:05:11.863 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-09-29T23:05:10.840170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":374797520,"kb_used":3186268,"kb_used_data":371611260,"kb_used_omap":1450,"kb_used_meta":0,"kb_avail":371611252,"statfs":{"total":383792660480,"available":380529922048,"internally_reserved":8192,"allocated":380529930240,"data_stored":380529930240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1485004,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":99,"commit_latency_ns":0,"apply_latency_ns":99000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.003939"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.257643+0000","last_change":"2023-09-29T23:05:04.257449+0000","last_active":"2023-09-29T23:05:04.257643+0000","last_peered":"2023-09-29T23:05:04.257643+0000","last_clean":"2023-09-29T23:05:04.257643+0000","last_became_active":"2023-09-29T23:05:04.257210+0000","last_became_peered":"2023-09-29T23:05:04.257210+0000","last_unstale":"2023-09-29T23:05:04.257643+0000","last_undegraded":"2023-09-29T23:05:04.257643+0000","last_fullsized":"2023-09-29T23:05:04.257643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:38.742119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215550+0000","last_change":"2023-09-29T23:05:04.215439+0000","last_active":"2023-09-29T23:05:04.215550+0000","last_peered":"2023-09-29T23:05:04.215550+0000","last_clean":"2023-09-29T23:05:04.215550+0000","last_became_active":"2023-09-29T23:05:04.214980+0000","last_became_peered":"2023-09-29T23:05:04.214980+0000","last_unstale":"2023-09-29T23:05:04.215550+0000","last_undegraded":"2023-09-29T23:05:04.215550+0000","last_fullsized":"2023-09-29T23:05:04.215550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:34:27.728165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.237122+0000","last_change":"2023-09-29T23:05:04.216611+0000","last_active":"2023-09-29T23:05:04.237122+0000","last_peered":"2023-09-29T23:05:04.237122+0000","last_clean":"2023-09-29T23:05:04.237122+0000","last_became_active":"2023-09-29T23:05:04.216198+0000","last_became_peered":"2023-09-29T23:05:04.216198+0000","last_unstale":"2023-09-29T23:05:04.237122+0000","last_undegraded":"2023-09-29T23:05:04.237122+0000","last_fullsized":"2023-09-29T23:05:04.237122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:35:44.332270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.241926+0000","last_change":"2023-09-29T23:05:04.241725+0000","last_active":"2023-09-29T23:05:04.241926+0000","last_peered":"2023-09-29T23:05:04.241926+0000","last_clean":"2023-09-29T23:05:04.241926+0000","last_became_active":"2023-09-29T23:05:04.241407+0000","last_became_peered":"2023-09-29T23:05:04.241407+0000","last_unstale":"2023-09-29T23:05:04.241926+0000","last_undegraded":"2023-09-29T23:05:04.241926+0000","last_fullsized":"2023-09-29T23:05:04.241926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:38:28.150922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289101+0000","last_change":"2023-09-29T23:05:04.288885+0000","last_active":"2023-09-29T23:05:04.289101+0000","last_peered":"2023-09-29T23:05:04.289101+0000","last_clean":"2023-09-29T23:05:04.289101+0000","last_became_active":"2023-09-29T23:05:04.287799+0000","last_became_peered":"2023-09-29T23:05:04.287799+0000","last_unstale":"2023-09-29T23:05:04.289101+0000","last_undegraded":"2023-09-29T23:05:04.289101+0000","last_fullsized":"2023-09-29T23:05:04.289101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:47:02.919688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.287438+0000","last_change":"2023-09-29T23:05:04.287112+0000","last_active":"2023-09-29T23:05:04.287438+0000","last_peered":"2023-09-29T23:05:04.287438+0000","last_clean":"2023-09-29T23:05:04.287438+0000","last_became_active":"2023-09-29T23:05:04.286712+0000","last_became_peered":"2023-09-29T23:05:04.286712+0000","last_unstale":"2023-09-29T23:05:04.287438+0000","last_undegraded":"2023-09-29T23:05:04.287438+0000","last_fullsized":"2023-09-29T23:05:04.287438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:29:45.889254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.283834+0000","last_change":"2023-09-29T23:05:04.283621+0000","last_active":"2023-09-29T23:05:04.283834+0000","last_peered":"2023-09-29T23:05:04.283834+0000","last_clean":"2023-09-29T23:05:04.283834+0000","last_became_active":"2023-09-29T23:05:04.283161+0000","last_became_peered":"2023-09-29T23:05:04.283161+0000","last_unstale":"2023-09-29T23:05:04.283834+0000","last_undegraded":"2023-09-29T23:05:04.283834+0000","last_fullsized":"2023-09-29T23:05:04.283834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:03.578342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.273569+0000","last_change":"2023-09-29T23:05:04.252862+0000","last_active":"2023-09-29T23:05:04.273569+0000","last_peered":"2023-09-29T23:05:04.273569+0000","last_clean":"2023-09-29T23:05:04.273569+0000","last_became_active":"2023-09-29T23:05:04.218911+0000","last_became_peered":"2023-09-29T23:05:04.218911+0000","last_unstale":"2023-09-29T23:05:04.273569+0000","last_undegraded":"2023-09-29T23:05:04.273569+0000","last_fullsized":"2023-09-29T23:05:04.273569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:13:25.338782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251870+0000","last_change":"2023-09-29T23:05:04.251712+0000","last_active":"2023-09-29T23:05:04.251870+0000","last_peered":"2023-09-29T23:05:04.251870+0000","last_clean":"2023-09-29T23:05:04.251870+0000","last_became_active":"2023-09-29T23:05:04.251307+0000","last_became_peered":"2023-09-29T23:05:04.251307+0000","last_unstale":"2023-09-29T23:05:04.251870+0000","last_undegraded":"2023-09-29T23:05:04.251870+0000","last_fullsized":"2023-09-29T23:05:04.251870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:01.217080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.213117+0000","last_change":"2023-09-29T23:05:04.207656+0000","last_active":"2023-09-29T23:05:04.213117+0000","last_peered":"2023-09-29T23:05:04.213117+0000","last_clean":"2023-09-29T23:05:04.213117+0000","last_became_active":"2023-09-29T23:05:04.207391+0000","last_became_peered":"2023-09-29T23:05:04.207391+0000","last_unstale":"2023-09-29T23:05:04.213117+0000","last_undegraded":"2023-09-29T23:05:04.213117+0000","last_fullsized":"2023-09-29T23:05:04.213117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:30:49.612686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.221774+0000","last_change":"2023-09-29T23:05:04.219341+0000","last_active":"2023-09-29T23:05:04.221774+0000","last_peered":"2023-09-29T23:05:04.221774+0000","last_clean":"2023-09-29T23:05:04.221774+0000","last_became_active":"2023-09-29T23:05:04.214471+0000","last_became_peered":"2023-09-29T23:05:04.214471+0000","last_unstale":"2023-09-29T23:05:04.221774+0000","last_undegraded":"2023-09-29T23:05:04.221774+0000","last_fullsized":"2023-09-29T23:05:04.221774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:17.918744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214371+0000","last_change":"2023-09-29T23:05:04.214126+0000","last_active":"2023-09-29T23:05:04.214371+0000","last_peered":"2023-09-29T23:05:04.214371+0000","last_clean":"2023-09-29T23:05:04.214371+0000","last_became_active":"2023-09-29T23:05:04.213622+0000","last_became_peered":"2023-09-29T23:05:04.213622+0000","last_unstale":"2023-09-29T23:05:04.214371+0000","last_undegraded":"2023-09-29T23:05:04.214371+0000","last_fullsized":"2023-09-29T23:05:04.214371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:49:54.525277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.245601+0000","last_change":"2023-09-29T23:05:04.245433+0000","last_active":"2023-09-29T23:05:04.245601+0000","last_peered":"2023-09-29T23:05:04.245601+0000","last_clean":"2023-09-29T23:05:04.245601+0000","last_became_active":"2023-09-29T23:05:04.245108+0000","last_became_peered":"2023-09-29T23:05:04.245108+0000","last_unstale":"2023-09-29T23:05:04.245601+0000","last_undegraded":"2023-09-29T23:05:04.245601+0000","last_fullsized":"2023-09-29T23:05:04.245601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:57:21.246456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.273050+0000","last_change":"2023-09-29T23:05:04.252793+0000","last_active":"2023-09-29T23:05:04.273050+0000","last_peered":"2023-09-29T23:05:04.273050+0000","last_clean":"2023-09-29T23:05:04.273050+0000","last_became_active":"2023-09-29T23:05:04.217886+0000","last_became_peered":"2023-09-29T23:05:04.217886+0000","last_unstale":"2023-09-29T23:05:04.273050+0000","last_undegraded":"2023-09-29T23:05:04.273050+0000","last_fullsized":"2023-09-29T23:05:04.273050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:19:44.907220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215685+0000","last_change":"2023-09-29T23:05:04.215591+0000","last_active":"2023-09-29T23:05:04.215685+0000","last_peered":"2023-09-29T23:05:04.215685+0000","last_clean":"2023-09-29T23:05:04.215685+0000","last_became_active":"2023-09-29T23:05:04.215340+0000","last_became_peered":"2023-09-29T23:05:04.215340+0000","last_unstale":"2023-09-29T23:05:04.215685+0000","last_undegraded":"2023-09-29T23:05:04.215685+0000","last_fullsized":"2023-09-29T23:05:04.215685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:46:26.690662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214466+0000","last_change":"2023-09-29T23:05:04.214368+0000","last_active":"2023-09-29T23:05:04.214466+0000","last_peered":"2023-09-29T23:05:04.214466+0000","last_clean":"2023-09-29T23:05:04.214466+0000","last_became_active":"2023-09-29T23:05:04.214191+0000","last_became_peered":"2023-09-29T23:05:04.214191+0000","last_unstale":"2023-09-29T23:05:04.214466+0000","last_undegraded":"2023-09-29T23:05:04.214466+0000","last_fullsized":"2023-09-29T23:05:04.214466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:03.345234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.221762+0000","last_change":"2023-09-29T23:05:04.219335+0000","last_active":"2023-09-29T23:05:04.221762+0000","last_peered":"2023-09-29T23:05:04.221762+0000","last_clean":"2023-09-29T23:05:04.221762+0000","last_became_active":"2023-09-29T23:05:04.215239+0000","last_became_peered":"2023-09-29T23:05:04.215239+0000","last_unstale":"2023-09-29T23:05:04.221762+0000","last_undegraded":"2023-09-29T23:05:04.221762+0000","last_fullsized":"2023-09-29T23:05:04.221762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:08:43.654146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251901+0000","last_change":"2023-09-29T23:05:04.249753+0000","last_active":"2023-09-29T23:05:04.251901+0000","last_peered":"2023-09-29T23:05:04.251901+0000","last_clean":"2023-09-29T23:05:04.251901+0000","last_became_active":"2023-09-29T23:05:04.242975+0000","last_became_peered":"2023-09-29T23:05:04.242975+0000","last_unstale":"2023-09-29T23:05:04.251901+0000","last_undegraded":"2023-09-29T23:05:04.251901+0000","last_fullsized":"2023-09-29T23:05:04.251901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:56.707907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.243997+0000","last_change":"2023-09-29T23:05:04.243808+0000","last_active":"2023-09-29T23:05:04.243997+0000","last_peered":"2023-09-29T23:05:04.243997+0000","last_clean":"2023-09-29T23:05:04.243997+0000","last_became_active":"2023-09-29T23:05:04.243359+0000","last_became_peered":"2023-09-29T23:05:04.243359+0000","last_unstale":"2023-09-29T23:05:04.243997+0000","last_undegraded":"2023-09-29T23:05:04.243997+0000","last_fullsized":"2023-09-29T23:05:04.243997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:44:31.354129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.205854+0000","last_change":"2023-09-29T23:05:04.200998+0000","last_active":"2023-09-29T23:05:04.205854+0000","last_peered":"2023-09-29T23:05:04.205854+0000","last_clean":"2023-09-29T23:05:04.205854+0000","last_became_active":"2023-09-29T23:05:04.200282+0000","last_became_peered":"2023-09-29T23:05:04.200282+0000","last_unstale":"2023-09-29T23:05:04.205854+0000","last_undegraded":"2023-09-29T23:05:04.205854+0000","last_fullsized":"2023-09-29T23:05:04.205854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:00:59.236159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.286652+0000","last_change":"2023-09-29T23:05:04.284770+0000","last_active":"2023-09-29T23:05:04.286652+0000","last_peered":"2023-09-29T23:05:04.286652+0000","last_clean":"2023-09-29T23:05:04.286652+0000","last_became_active":"2023-09-29T23:05:04.252823+0000","last_became_peered":"2023-09-29T23:05:04.252823+0000","last_unstale":"2023-09-29T23:05:04.286652+0000","last_undegraded":"2023-09-29T23:05:04.286652+0000","last_fullsized":"2023-09-29T23:05:04.286652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:32:26.941552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.200453+0000","last_change":"2023-09-29T23:05:04.199157+0000","last_active":"2023-09-29T23:05:04.200453+0000","last_peered":"2023-09-29T23:05:04.200453+0000","last_clean":"2023-09-29T23:05:04.200453+0000","last_became_active":"2023-09-29T23:05:04.198882+0000","last_became_peered":"2023-09-29T23:05:04.198882+0000","last_unstale":"2023-09-29T23:05:04.200453+0000","last_undegraded":"2023-09-29T23:05:04.200453+0000","last_fullsized":"2023-09-29T23:05:04.200453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:12:54.806149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.254837+0000","last_change":"2023-09-29T23:05:04.251583+0000","last_active":"2023-09-29T23:05:04.254837+0000","last_peered":"2023-09-29T23:05:04.254837+0000","last_clean":"2023-09-29T23:05:04.254837+0000","last_became_active":"2023-09-29T23:05:04.244751+0000","last_became_peered":"2023-09-29T23:05:04.244751+0000","last_unstale":"2023-09-29T23:05:04.254837+0000","last_undegraded":"2023-09-29T23:05:04.254837+0000","last_fullsized":"2023-09-29T23:05:04.254837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:25:59.686794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.287155+0000","last_change":"2023-09-29T23:05:04.283668+0000","last_active":"2023-09-29T23:05:04.287155+0000","last_peered":"2023-09-29T23:05:04.287155+0000","last_clean":"2023-09-29T23:05:04.287155+0000","last_became_active":"2023-09-29T23:05:04.273847+0000","last_became_peered":"2023-09-29T23:05:04.273847+0000","last_unstale":"2023-09-29T23:05:04.287155+0000","last_undegraded":"2023-09-29T23:05:04.287155+0000","last_fullsized":"2023-09-29T23:05:04.287155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:04:54.695586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.207402+0000","last_change":"2023-09-29T23:05:04.206976+0000","last_active":"2023-09-29T23:05:04.207402+0000","last_peered":"2023-09-29T23:05:04.207402+0000","last_clean":"2023-09-29T23:05:04.207402+0000","last_became_active":"2023-09-29T23:05:04.202100+0000","last_became_peered":"2023-09-29T23:05:04.202100+0000","last_unstale":"2023-09-29T23:05:04.207402+0000","last_undegraded":"2023-09-29T23:05:04.207402+0000","last_fullsized":"2023-09-29T23:05:04.207402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:46:35.535828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.227549+0000","last_change":"2023-09-29T23:05:04.227117+0000","last_active":"2023-09-29T23:05:04.227549+0000","last_peered":"2023-09-29T23:05:04.227549+0000","last_clean":"2023-09-29T23:05:04.227549+0000","last_became_active":"2023-09-29T23:05:04.222967+0000","last_became_peered":"2023-09-29T23:05:04.222967+0000","last_unstale":"2023-09-29T23:05:04.227549+0000","last_undegraded":"2023-09-29T23:05:04.227549+0000","last_fullsized":"2023-09-29T23:05:04.227549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:04:36.437126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.287315+0000","last_change":"2023-09-29T23:05:04.283985+0000","last_active":"2023-09-29T23:05:04.287315+0000","last_peered":"2023-09-29T23:05:04.287315+0000","last_clean":"2023-09-29T23:05:04.287315+0000","last_became_active":"2023-09-29T23:05:04.263745+0000","last_became_peered":"2023-09-29T23:05:04.263745+0000","last_unstale":"2023-09-29T23:05:04.287315+0000","last_undegraded":"2023-09-29T23:05:04.287315+0000","last_fullsized":"2023-09-29T23:05:04.287315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:15:21.618051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.228517+0000","last_change":"2023-09-29T23:05:04.227873+0000","last_active":"2023-09-29T23:05:04.228517+0000","last_peered":"2023-09-29T23:05:04.228517+0000","last_clean":"2023-09-29T23:05:04.228517+0000","last_became_active":"2023-09-29T23:05:04.221191+0000","last_became_peered":"2023-09-29T23:05:04.221191+0000","last_unstale":"2023-09-29T23:05:04.228517+0000","last_undegraded":"2023-09-29T23:05:04.228517+0000","last_fullsized":"2023-09-29T23:05:04.228517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:27:03.221776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289354+0000","last_change":"2023-09-29T23:05:04.289174+0000","last_active":"2023-09-29T23:05:04.289354+0000","last_peered":"2023-09-29T23:05:04.289354+0000","last_clean":"2023-09-29T23:05:04.289354+0000","last_became_active":"2023-09-29T23:05:04.288438+0000","last_became_peered":"2023-09-29T23:05:04.288438+0000","last_unstale":"2023-09-29T23:05:04.289354+0000","last_undegraded":"2023-09-29T23:05:04.289354+0000","last_fullsized":"2023-09-29T23:05:04.289354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:34:48.714874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.200418+0000","last_change":"2023-09-29T23:05:04.198674+0000","last_active":"2023-09-29T23:05:04.200418+0000","last_peered":"2023-09-29T23:05:04.200418+0000","last_clean":"2023-09-29T23:05:04.200418+0000","last_became_active":"2023-09-29T23:05:04.198381+0000","last_became_peered":"2023-09-29T23:05:04.198381+0000","last_unstale":"2023-09-29T23:05:04.200418+0000","last_undegraded":"2023-09-29T23:05:04.200418+0000","last_fullsized":"2023-09-29T23:05:04.200418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:03:27.134395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.256621+0000","last_change":"2023-09-29T23:05:04.254962+0000","last_active":"2023-09-29T23:05:04.256621+0000","last_peered":"2023-09-29T23:05:04.256621+0000","last_clean":"2023-09-29T23:05:04.256621+0000","last_became_active":"2023-09-29T23:05:04.250064+0000","last_became_peered":"2023-09-29T23:05:04.250064+0000","last_unstale":"2023-09-29T23:05:04.256621+0000","last_undegraded":"2023-09-29T23:05:04.256621+0000","last_fullsized":"2023-09-29T23:05:04.256621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:30:49.612686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214978+0000","last_change":"2023-09-29T23:05:04.214801+0000","last_active":"2023-09-29T23:05:04.214978+0000","last_peered":"2023-09-29T23:05:04.214978+0000","last_clean":"2023-09-29T23:05:04.214978+0000","last_became_active":"2023-09-29T23:05:04.214399+0000","last_became_peered":"2023-09-29T23:05:04.214399+0000","last_unstale":"2023-09-29T23:05:04.214978+0000","last_undegraded":"2023-09-29T23:05:04.214978+0000","last_fullsized":"2023-09-29T23:05:04.214978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:25:30.824854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.244676+0000","last_change":"2023-09-29T23:05:04.240504+0000","last_active":"2023-09-29T23:05:04.244676+0000","last_peered":"2023-09-29T23:05:04.244676+0000","last_clean":"2023-09-29T23:05:04.244676+0000","last_became_active":"2023-09-29T23:05:04.214295+0000","last_became_peered":"2023-09-29T23:05:04.214295+0000","last_unstale":"2023-09-29T23:05:04.244676+0000","last_undegraded":"2023-09-29T23:05:04.244676+0000","last_fullsized":"2023-09-29T23:05:04.244676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:17.918744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289971+0000","last_change":"2023-09-29T23:05:03.922718+0000","last_active":"2023-09-29T23:05:04.289971+0000","last_peered":"2023-09-29T23:05:04.289971+0000","last_clean":"2023-09-29T23:05:04.289971+0000","last_became_active":"2023-09-29T23:05:03.922067+0000","last_became_peered":"2023-09-29T23:05:03.922067+0000","last_unstale":"2023-09-29T23:05:04.289971+0000","last_undegraded":"2023-09-29T23:05:04.289971+0000","last_fullsized":"2023-09-29T23:05:04.289971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.286074+0000","last_change":"2023-09-29T23:05:04.285799+0000","last_active":"2023-09-29T23:05:04.286074+0000","last_peered":"2023-09-29T23:05:04.286074+0000","last_clean":"2023-09-29T23:05:04.286074+0000","last_became_active":"2023-09-29T23:05:04.285269+0000","last_became_peered":"2023-09-29T23:05:04.285269+0000","last_unstale":"2023-09-29T23:05:04.286074+0000","last_undegraded":"2023-09-29T23:05:04.286074+0000","last_fullsized":"2023-09-29T23:05:04.286074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:46:23.962799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.213085+0000","last_change":"2023-09-29T23:05:03.862184+0000","last_active":"2023-09-29T23:05:04.213085+0000","last_peered":"2023-09-29T23:05:04.213085+0000","last_clean":"2023-09-29T23:05:04.213085+0000","last_became_active":"2023-09-29T23:05:03.861944+0000","last_became_peered":"2023-09-29T23:05:03.861944+0000","last_unstale":"2023-09-29T23:05:04.213085+0000","last_undegraded":"2023-09-29T23:05:04.213085+0000","last_fullsized":"2023-09-29T23:05:04.213085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.249622+0000","last_change":"2023-09-29T23:05:04.243484+0000","last_active":"2023-09-29T23:05:04.249622+0000","last_peered":"2023-09-29T23:05:04.249622+0000","last_clean":"2023-09-29T23:05:04.249622+0000","last_became_active":"2023-09-29T23:05:04.216763+0000","last_became_peered":"2023-09-29T23:05:04.216763+0000","last_unstale":"2023-09-29T23:05:04.249622+0000","last_undegraded":"2023-09-29T23:05:04.249622+0000","last_fullsized":"2023-09-29T23:05:04.249622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:28.548035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.193790+0000","last_change":"2023-09-29T23:05:03.860077+0000","last_active":"2023-09-29T23:05:04.193790+0000","last_peered":"2023-09-29T23:05:04.193790+0000","last_clean":"2023-09-29T23:05:04.193790+0000","last_became_active":"2023-09-29T23:05:03.859776+0000","last_became_peered":"2023-09-29T23:05:03.859776+0000","last_unstale":"2023-09-29T23:05:04.193790+0000","last_undegraded":"2023-09-29T23:05:04.193790+0000","last_fullsized":"2023-09-29T23:05:04.193790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:27:57.781735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.257308+0000","last_change":"2023-09-29T23:05:04.257031+0000","last_active":"2023-09-29T23:05:04.257308+0000","last_peered":"2023-09-29T23:05:04.257308+0000","last_clean":"2023-09-29T23:05:04.257308+0000","last_became_active":"2023-09-29T23:05:04.255274+0000","last_became_peered":"2023-09-29T23:05:04.255274+0000","last_unstale":"2023-09-29T23:05:04.257308+0000","last_undegraded":"2023-09-29T23:05:04.257308+0000","last_fullsized":"2023-09-29T23:05:04.257308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:08:19.473130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.295273+0000","last_change":"2023-09-29T23:05:03.849842+0000","last_active":"2023-09-29T23:05:04.295273+0000","last_peered":"2023-09-29T23:05:04.295273+0000","last_clean":"2023-09-29T23:05:04.295273+0000","last_became_active":"2023-09-29T23:05:03.849529+0000","last_became_peered":"2023-09-29T23:05:03.849529+0000","last_unstale":"2023-09-29T23:05:04.295273+0000","last_undegraded":"2023-09-29T23:05:04.295273+0000","last_fullsized":"2023-09-29T23:05:04.295273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.282898+0000","last_change":"2023-09-29T23:05:03.853590+0000","last_active":"2023-09-29T23:05:04.282898+0000","last_peered":"2023-09-29T23:05:04.282898+0000","last_clean":"2023-09-29T23:05:04.282898+0000","last_became_active":"2023-09-29T23:05:03.853335+0000","last_became_peered":"2023-09-29T23:05:03.853335+0000","last_unstale":"2023-09-29T23:05:04.282898+0000","last_undegraded":"2023-09-29T23:05:04.282898+0000","last_fullsized":"2023-09-29T23:05:04.282898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:57:20.234700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.285465+0000","last_change":"2023-09-29T23:05:04.285189+0000","last_active":"2023-09-29T23:05:04.285465+0000","last_peered":"2023-09-29T23:05:04.285465+0000","last_clean":"2023-09-29T23:05:04.285465+0000","last_became_active":"2023-09-29T23:05:04.284565+0000","last_became_peered":"2023-09-29T23:05:04.284565+0000","last_unstale":"2023-09-29T23:05:04.285465+0000","last_undegraded":"2023-09-29T23:05:04.285465+0000","last_fullsized":"2023-09-29T23:05:04.285465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:07:06.833043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.282729+0000","last_change":"2023-09-29T23:05:03.853815+0000","last_active":"2023-09-29T23:05:04.282729+0000","last_peered":"2023-09-29T23:05:04.282729+0000","last_clean":"2023-09-29T23:05:04.282729+0000","last_became_active":"2023-09-29T23:05:03.853456+0000","last_became_peered":"2023-09-29T23:05:03.853456+0000","last_unstale":"2023-09-29T23:05:04.282729+0000","last_undegraded":"2023-09-29T23:05:04.282729+0000","last_fullsized":"2023-09-29T23:05:04.282729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.213885+0000","last_change":"2023-09-29T23:05:04.211018+0000","last_active":"2023-09-29T23:05:04.213885+0000","last_peered":"2023-09-29T23:05:04.213885+0000","last_clean":"2023-09-29T23:05:04.213885+0000","last_became_active":"2023-09-29T23:05:04.210759+0000","last_became_peered":"2023-09-29T23:05:04.210759+0000","last_unstale":"2023-09-29T23:05:04.213885+0000","last_undegraded":"2023-09-29T23:05:04.213885+0000","last_fullsized":"2023-09-29T23:05:04.213885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:28.548035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.288181+0000","last_change":"2023-09-29T23:05:03.888787+0000","last_active":"2023-09-29T23:05:04.288181+0000","last_peered":"2023-09-29T23:05:04.288181+0000","last_clean":"2023-09-29T23:05:04.288181+0000","last_became_active":"2023-09-29T23:05:03.872538+0000","last_became_peered":"2023-09-29T23:05:03.872538+0000","last_unstale":"2023-09-29T23:05:04.288181+0000","last_undegraded":"2023-09-29T23:05:04.288181+0000","last_fullsized":"2023-09-29T23:05:04.288181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:37.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.286630+0000","last_change":"2023-09-29T23:05:04.284542+0000","last_active":"2023-09-29T23:05:04.286630+0000","last_peered":"2023-09-29T23:05:04.286630+0000","last_clean":"2023-09-29T23:05:04.286630+0000","last_became_active":"2023-09-29T23:05:04.273338+0000","last_became_peered":"2023-09-29T23:05:04.273338+0000","last_unstale":"2023-09-29T23:05:04.286630+0000","last_undegraded":"2023-09-29T23:05:04.286630+0000","last_fullsized":"2023-09-29T23:05:04.286630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:32:25.478744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.194998+0000","last_change":"2023-09-29T23:05:03.875076+0000","last_active":"2023-09-29T23:05:04.194998+0000","last_peered":"2023-09-29T23:05:04.194998+0000","last_clean":"2023-09-29T23:05:04.194998+0000","last_became_active":"2023-09-29T23:05:03.862493+0000","last_became_peered":"2023-09-29T23:05:03.862493+0000","last_unstale":"2023-09-29T23:05:04.194998+0000","last_undegraded":"2023-09-29T23:05:04.194998+0000","last_fullsized":"2023-09-29T23:05:04.194998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:52.829419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.219724+0000","last_change":"2023-09-29T23:05:04.218004+0000","last_active":"2023-09-29T23:05:04.219724+0000","last_peered":"2023-09-29T23:05:04.219724+0000","last_clean":"2023-09-29T23:05:04.219724+0000","last_became_active":"2023-09-29T23:05:04.217739+0000","last_became_peered":"2023-09-29T23:05:04.217739+0000","last_unstale":"2023-09-29T23:05:04.219724+0000","last_undegraded":"2023-09-29T23:05:04.219724+0000","last_fullsized":"2023-09-29T23:05:04.219724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:42:01.814209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.244687+0000","last_change":"2023-09-29T23:05:03.879324+0000","last_active":"2023-09-29T23:05:04.244687+0000","last_peered":"2023-09-29T23:05:04.244687+0000","last_clean":"2023-09-29T23:05:04.244687+0000","last_became_active":"2023-09-29T23:05:03.874684+0000","last_became_peered":"2023-09-29T23:05:03.874684+0000","last_unstale":"2023-09-29T23:05:04.244687+0000","last_undegraded":"2023-09-29T23:05:04.244687+0000","last_fullsized":"2023-09-29T23:05:04.244687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:07:10.402882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214075+0000","last_change":"2023-09-29T23:05:04.213340+0000","last_active":"2023-09-29T23:05:04.214075+0000","last_peered":"2023-09-29T23:05:04.214075+0000","last_clean":"2023-09-29T23:05:04.214075+0000","last_became_active":"2023-09-29T23:05:04.210965+0000","last_became_peered":"2023-09-29T23:05:04.210965+0000","last_unstale":"2023-09-29T23:05:04.214075+0000","last_undegraded":"2023-09-29T23:05:04.214075+0000","last_fullsized":"2023-09-29T23:05:04.214075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:03.345234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196156+0000","last_change":"2023-09-29T23:05:03.851543+0000","last_active":"2023-09-29T23:05:04.196156+0000","last_peered":"2023-09-29T23:05:04.196156+0000","last_clean":"2023-09-29T23:05:04.196156+0000","last_became_active":"2023-09-29T23:05:03.849728+0000","last_became_peered":"2023-09-29T23:05:03.849728+0000","last_unstale":"2023-09-29T23:05:04.196156+0000","last_undegraded":"2023-09-29T23:05:04.196156+0000","last_fullsized":"2023-09-29T23:05:04.196156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.284127+0000","last_change":"2023-09-29T23:05:04.282192+0000","last_active":"2023-09-29T23:05:04.284127+0000","last_peered":"2023-09-29T23:05:04.284127+0000","last_clean":"2023-09-29T23:05:04.284127+0000","last_became_active":"2023-09-29T23:05:04.236675+0000","last_became_peered":"2023-09-29T23:05:04.236675+0000","last_unstale":"2023-09-29T23:05:04.284127+0000","last_undegraded":"2023-09-29T23:05:04.284127+0000","last_fullsized":"2023-09-29T23:05:04.284127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:03:02.248216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.202259+0000","last_change":"2023-09-29T23:05:03.873312+0000","last_active":"2023-09-29T23:05:04.202259+0000","last_peered":"2023-09-29T23:05:04.202259+0000","last_clean":"2023-09-29T23:05:04.202259+0000","last_became_active":"2023-09-29T23:05:03.867491+0000","last_became_peered":"2023-09-29T23:05:03.867491+0000","last_unstale":"2023-09-29T23:05:04.202259+0000","last_undegraded":"2023-09-29T23:05:04.202259+0000","last_fullsized":"2023-09-29T23:05:04.202259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:21:38.208894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.217230+0000","last_change":"2023-09-29T23:05:04.217019+0000","last_active":"2023-09-29T23:05:04.217230+0000","last_peered":"2023-09-29T23:05:04.217230+0000","last_clean":"2023-09-29T23:05:04.217230+0000","last_became_active":"2023-09-29T23:05:04.216375+0000","last_became_peered":"2023-09-29T23:05:04.216375+0000","last_unstale":"2023-09-29T23:05:04.217230+0000","last_undegraded":"2023-09-29T23:05:04.217230+0000","last_fullsized":"2023-09-29T23:05:04.217230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:30.237110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.202584+0000","last_change":"2023-09-29T23:05:03.878136+0000","last_active":"2023-09-29T23:05:04.202584+0000","last_peered":"2023-09-29T23:05:04.202584+0000","last_clean":"2023-09-29T23:05:04.202584+0000","last_became_active":"2023-09-29T23:05:03.872575+0000","last_became_peered":"2023-09-29T23:05:03.872575+0000","last_unstale":"2023-09-29T23:05:04.202584+0000","last_undegraded":"2023-09-29T23:05:04.202584+0000","last_fullsized":"2023-09-29T23:05:04.202584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:18:45.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215946+0000","last_change":"2023-09-29T23:05:04.213849+0000","last_active":"2023-09-29T23:05:04.215946+0000","last_peered":"2023-09-29T23:05:04.215946+0000","last_clean":"2023-09-29T23:05:04.215946+0000","last_became_active":"2023-09-29T23:05:04.210814+0000","last_became_peered":"2023-09-29T23:05:04.210814+0000","last_unstale":"2023-09-29T23:05:04.215946+0000","last_undegraded":"2023-09-29T23:05:04.215946+0000","last_fullsized":"2023-09-29T23:05:04.215946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:32:26.941552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":166,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.191250+0000","last_change":"2023-09-29T23:04:56.664338+0000","last_active":"2023-09-29T23:05:04.191250+0000","last_peered":"2023-09-29T23:05:04.191250+0000","last_clean":"2023-09-29T23:05:04.191250+0000","last_became_active":"2023-09-29T23:04:56.663441+0000","last_became_peered":"2023-09-29T23:04:56.663441+0000","last_unstale":"2023-09-29T23:05:04.191250+0000","last_undegraded":"2023-09-29T23:05:04.191250+0000","last_fullsized":"2023-09-29T23:05:04.191250+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_clean_scrub_stamp":"2023-09-29T23:04:55.640704+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:54:28.112724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196955+0000","last_change":"2023-09-29T23:04:59.797078+0000","last_active":"2023-09-29T23:05:04.196955+0000","last_peered":"2023-09-29T23:05:04.196955+0000","last_clean":"2023-09-29T23:05:04.196955+0000","last_became_active":"2023-09-29T23:04:59.795998+0000","last_became_peered":"2023-09-29T23:04:59.795998+0000","last_unstale":"2023-09-29T23:05:04.196955+0000","last_undegraded":"2023-09-29T23:05:04.196955+0000","last_fullsized":"2023-09-29T23:05:04.196955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.202646+0000","last_change":"2023-09-29T23:05:03.890967+0000","last_active":"2023-09-29T23:05:04.202646+0000","last_peered":"2023-09-29T23:05:04.202646+0000","last_clean":"2023-09-29T23:05:04.202646+0000","last_became_active":"2023-09-29T23:05:03.890727+0000","last_became_peered":"2023-09-29T23:05:03.890727+0000","last_unstale":"2023-09-29T23:05:04.202646+0000","last_undegraded":"2023-09-29T23:05:04.202646+0000","last_fullsized":"2023-09-29T23:05:04.202646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:56:45.933376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.237040+0000","last_change":"2023-09-29T23:05:04.216483+0000","last_active":"2023-09-29T23:05:04.237040+0000","last_peered":"2023-09-29T23:05:04.237040+0000","last_clean":"2023-09-29T23:05:04.237040+0000","last_became_active":"2023-09-29T23:05:04.215884+0000","last_became_peered":"2023-09-29T23:05:04.215884+0000","last_unstale":"2023-09-29T23:05:04.237040+0000","last_undegraded":"2023-09-29T23:05:04.237040+0000","last_fullsized":"2023-09-29T23:05:04.237040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:36:17.108632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195257+0000","last_change":"2023-09-29T23:04:59.798054+0000","last_active":"2023-09-29T23:05:04.195257+0000","last_peered":"2023-09-29T23:05:04.195257+0000","last_clean":"2023-09-29T23:05:04.195257+0000","last_became_active":"2023-09-29T23:04:59.797489+0000","last_became_peered":"2023-09-29T23:04:59.797489+0000","last_unstale":"2023-09-29T23:05:04.195257+0000","last_undegraded":"2023-09-29T23:05:04.195257+0000","last_fullsized":"2023-09-29T23:05:04.195257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:32:42.777486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.191583+0000","last_change":"2023-09-29T23:05:03.851676+0000","last_active":"2023-09-29T23:05:04.191583+0000","last_peered":"2023-09-29T23:05:04.191583+0000","last_clean":"2023-09-29T23:05:04.191583+0000","last_became_active":"2023-09-29T23:05:03.851368+0000","last_became_peered":"2023-09-29T23:05:03.851368+0000","last_unstale":"2023-09-29T23:05:04.191583+0000","last_undegraded":"2023-09-29T23:05:04.191583+0000","last_fullsized":"2023-09-29T23:05:04.191583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:43:41.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.254473+0000","last_change":"2023-09-29T23:05:04.251147+0000","last_active":"2023-09-29T23:05:04.254473+0000","last_peered":"2023-09-29T23:05:04.254473+0000","last_clean":"2023-09-29T23:05:04.254473+0000","last_became_active":"2023-09-29T23:05:04.248337+0000","last_became_peered":"2023-09-29T23:05:04.248337+0000","last_unstale":"2023-09-29T23:05:04.254473+0000","last_undegraded":"2023-09-29T23:05:04.254473+0000","last_fullsized":"2023-09-29T23:05:04.254473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:46:35.535828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.213083+0000","last_change":"2023-09-29T23:04:59.951828+0000","last_active":"2023-09-29T23:05:04.213083+0000","last_peered":"2023-09-29T23:05:04.213083+0000","last_clean":"2023-09-29T23:05:04.213083+0000","last_became_active":"2023-09-29T23:04:59.951181+0000","last_became_peered":"2023-09-29T23:04:59.951181+0000","last_unstale":"2023-09-29T23:05:04.213083+0000","last_undegraded":"2023-09-29T23:05:04.213083+0000","last_fullsized":"2023-09-29T23:05:04.213083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.190936+0000","last_change":"2023-09-29T23:05:03.847255+0000","last_active":"2023-09-29T23:05:04.190936+0000","last_peered":"2023-09-29T23:05:04.190936+0000","last_clean":"2023-09-29T23:05:04.190936+0000","last_became_active":"2023-09-29T23:05:03.846967+0000","last_became_peered":"2023-09-29T23:05:03.846967+0000","last_unstale":"2023-09-29T23:05:04.190936+0000","last_undegraded":"2023-09-29T23:05:04.190936+0000","last_fullsized":"2023-09-29T23:05:04.190936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:41:31.685195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215098+0000","last_change":"2023-09-29T23:05:04.213835+0000","last_active":"2023-09-29T23:05:04.215098+0000","last_peered":"2023-09-29T23:05:04.215098+0000","last_clean":"2023-09-29T23:05:04.215098+0000","last_became_active":"2023-09-29T23:05:04.210448+0000","last_became_peered":"2023-09-29T23:05:04.210448+0000","last_unstale":"2023-09-29T23:05:04.215098+0000","last_undegraded":"2023-09-29T23:05:04.215098+0000","last_fullsized":"2023-09-29T23:05:04.215098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:13:25.338782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196228+0000","last_change":"2023-09-29T23:04:59.797795+0000","last_active":"2023-09-29T23:05:04.196228+0000","last_peered":"2023-09-29T23:05:04.196228+0000","last_clean":"2023-09-29T23:05:04.196228+0000","last_became_active":"2023-09-29T23:04:59.796512+0000","last_became_peered":"2023-09-29T23:04:59.796512+0000","last_unstale":"2023-09-29T23:05:04.196228+0000","last_undegraded":"2023-09-29T23:05:04.196228+0000","last_fullsized":"2023-09-29T23:05:04.196228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196854+0000","last_change":"2023-09-29T23:05:03.848672+0000","last_active":"2023-09-29T23:05:04.196854+0000","last_peered":"2023-09-29T23:05:04.196854+0000","last_clean":"2023-09-29T23:05:04.196854+0000","last_became_active":"2023-09-29T23:05:03.848507+0000","last_became_peered":"2023-09-29T23:05:03.848507+0000","last_unstale":"2023-09-29T23:05:04.196854+0000","last_undegraded":"2023-09-29T23:05:04.196854+0000","last_fullsized":"2023-09-29T23:05:04.196854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:19:37.297844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.224301+0000","last_change":"2023-09-29T23:05:04.221133+0000","last_active":"2023-09-29T23:05:04.224301+0000","last_peered":"2023-09-29T23:05:04.224301+0000","last_clean":"2023-09-29T23:05:04.224301+0000","last_became_active":"2023-09-29T23:05:04.217328+0000","last_became_peered":"2023-09-29T23:05:04.217328+0000","last_unstale":"2023-09-29T23:05:04.224301+0000","last_undegraded":"2023-09-29T23:05:04.224301+0000","last_fullsized":"2023-09-29T23:05:04.224301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:25:30.824854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.197156+0000","last_change":"2023-09-29T23:05:03.860174+0000","last_active":"2023-09-29T23:05:04.197156+0000","last_peered":"2023-09-29T23:05:04.197156+0000","last_clean":"2023-09-29T23:05:04.197156+0000","last_became_active":"2023-09-29T23:05:03.859936+0000","last_became_peered":"2023-09-29T23:05:03.859936+0000","last_unstale":"2023-09-29T23:05:04.197156+0000","last_undegraded":"2023-09-29T23:05:04.197156+0000","last_fullsized":"2023-09-29T23:05:04.197156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:28:17.915992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196220+0000","last_change":"2023-09-29T23:04:59.952454+0000","last_active":"2023-09-29T23:05:04.196220+0000","last_peered":"2023-09-29T23:05:04.196220+0000","last_clean":"2023-09-29T23:05:04.196220+0000","last_became_active":"2023-09-29T23:04:59.951496+0000","last_became_peered":"2023-09-29T23:04:59.951496+0000","last_unstale":"2023-09-29T23:05:04.196220+0000","last_undegraded":"2023-09-29T23:05:04.196220+0000","last_fullsized":"2023-09-29T23:05:04.196220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.221477+0000","last_change":"2023-09-29T23:05:04.218913+0000","last_active":"2023-09-29T23:05:04.221477+0000","last_peered":"2023-09-29T23:05:04.221477+0000","last_clean":"2023-09-29T23:05:04.221477+0000","last_became_active":"2023-09-29T23:05:04.214274+0000","last_became_peered":"2023-09-29T23:05:04.214274+0000","last_unstale":"2023-09-29T23:05:04.221477+0000","last_undegraded":"2023-09-29T23:05:04.221477+0000","last_fullsized":"2023-09-29T23:05:04.221477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:13.653906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195181+0000","last_change":"2023-09-29T23:05:03.855922+0000","last_active":"2023-09-29T23:05:04.195181+0000","last_peered":"2023-09-29T23:05:04.195181+0000","last_clean":"2023-09-29T23:05:04.195181+0000","last_became_active":"2023-09-29T23:05:03.851814+0000","last_became_peered":"2023-09-29T23:05:03.851814+0000","last_unstale":"2023-09-29T23:05:04.195181+0000","last_undegraded":"2023-09-29T23:05:04.195181+0000","last_fullsized":"2023-09-29T23:05:04.195181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:29:31.409379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.197282+0000","last_change":"2023-09-29T23:04:59.798170+0000","last_active":"2023-09-29T23:05:04.197282+0000","last_peered":"2023-09-29T23:05:04.197282+0000","last_clean":"2023-09-29T23:05:04.197282+0000","last_became_active":"2023-09-29T23:04:59.797758+0000","last_became_peered":"2023-09-29T23:04:59.797758+0000","last_unstale":"2023-09-29T23:05:04.197282+0000","last_undegraded":"2023-09-29T23:05:04.197282+0000","last_fullsized":"2023-09-29T23:05:04.197282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:23.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.218604+0000","last_change":"2023-09-29T23:05:04.214002+0000","last_active":"2023-09-29T23:05:04.218604+0000","last_peered":"2023-09-29T23:05:04.218604+0000","last_clean":"2023-09-29T23:05:04.218604+0000","last_became_active":"2023-09-29T23:05:04.211171+0000","last_became_peered":"2023-09-29T23:05:04.211171+0000","last_unstale":"2023-09-29T23:05:04.218604+0000","last_undegraded":"2023-09-29T23:05:04.218604+0000","last_fullsized":"2023-09-29T23:05:04.218604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:47.693070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.257471+0000","last_change":"2023-09-29T23:05:03.879418+0000","last_active":"2023-09-29T23:05:04.257471+0000","last_peered":"2023-09-29T23:05:04.257471+0000","last_clean":"2023-09-29T23:05:04.257471+0000","last_became_active":"2023-09-29T23:05:03.875943+0000","last_became_peered":"2023-09-29T23:05:03.875943+0000","last_unstale":"2023-09-29T23:05:04.257471+0000","last_undegraded":"2023-09-29T23:05:04.257471+0000","last_fullsized":"2023-09-29T23:05:04.257471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:22:16.497716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.193202+0000","last_change":"2023-09-29T23:04:59.794782+0000","last_active":"2023-09-29T23:05:04.193202+0000","last_peered":"2023-09-29T23:05:04.193202+0000","last_clean":"2023-09-29T23:05:04.193202+0000","last_became_active":"2023-09-29T23:04:59.794073+0000","last_became_peered":"2023-09-29T23:04:59.794073+0000","last_unstale":"2023-09-29T23:05:04.193202+0000","last_undegraded":"2023-09-29T23:05:04.193202+0000","last_fullsized":"2023-09-29T23:05:04.193202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:44:24.462680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251889+0000","last_change":"2023-09-29T23:05:04.247583+0000","last_active":"2023-09-29T23:05:04.251889+0000","last_peered":"2023-09-29T23:05:04.251889+0000","last_clean":"2023-09-29T23:05:04.251889+0000","last_became_active":"2023-09-29T23:05:04.240435+0000","last_became_peered":"2023-09-29T23:05:04.240435+0000","last_unstale":"2023-09-29T23:05:04.251889+0000","last_undegraded":"2023-09-29T23:05:04.251889+0000","last_fullsized":"2023-09-29T23:05:04.251889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:22:03.314724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.192992+0000","last_change":"2023-09-29T23:05:03.851188+0000","last_active":"2023-09-29T23:05:04.192992+0000","last_peered":"2023-09-29T23:05:04.192992+0000","last_clean":"2023-09-29T23:05:04.192992+0000","last_became_active":"2023-09-29T23:05:03.850904+0000","last_became_peered":"2023-09-29T23:05:03.850904+0000","last_unstale":"2023-09-29T23:05:04.192992+0000","last_undegraded":"2023-09-29T23:05:04.192992+0000","last_fullsized":"2023-09-29T23:05:04.192992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:24.755498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195568+0000","last_change":"2023-09-29T23:04:59.799021+0000","last_active":"2023-09-29T23:05:04.195568+0000","last_peered":"2023-09-29T23:05:04.195568+0000","last_clean":"2023-09-29T23:05:04.195568+0000","last_became_active":"2023-09-29T23:04:59.797145+0000","last_became_peered":"2023-09-29T23:04:59.797145+0000","last_unstale":"2023-09-29T23:05:04.195568+0000","last_undegraded":"2023-09-29T23:05:04.195568+0000","last_fullsized":"2023-09-29T23:05:04.195568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:46:55.987895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214202+0000","last_change":"2023-09-29T23:05:04.213961+0000","last_active":"2023-09-29T23:05:04.214202+0000","last_peered":"2023-09-29T23:05:04.214202+0000","last_clean":"2023-09-29T23:05:04.214202+0000","last_became_active":"2023-09-29T23:05:04.213465+0000","last_became_peered":"2023-09-29T23:05:04.213465+0000","last_unstale":"2023-09-29T23:05:04.214202+0000","last_undegraded":"2023-09-29T23:05:04.214202+0000","last_fullsized":"2023-09-29T23:05:04.214202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:19:38.309600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.217738+0000","last_change":"2023-09-29T23:05:04.217546+0000","last_active":"2023-09-29T23:05:04.217738+0000","last_peered":"2023-09-29T23:05:04.217738+0000","last_clean":"2023-09-29T23:05:04.217738+0000","last_became_active":"2023-09-29T23:05:04.214680+0000","last_became_peered":"2023-09-29T23:05:04.214680+0000","last_unstale":"2023-09-29T23:05:04.217738+0000","last_undegraded":"2023-09-29T23:05:04.217738+0000","last_fullsized":"2023-09-29T23:05:04.217738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:16:39.068910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.291449+0000","last_change":"2023-09-29T23:05:03.853192+0000","last_active":"2023-09-29T23:05:04.291449+0000","last_peered":"2023-09-29T23:05:04.291449+0000","last_clean":"2023-09-29T23:05:04.291449+0000","last_became_active":"2023-09-29T23:05:03.852382+0000","last_became_peered":"2023-09-29T23:05:03.852382+0000","last_unstale":"2023-09-29T23:05:04.291449+0000","last_undegraded":"2023-09-29T23:05:04.291449+0000","last_fullsized":"2023-09-29T23:05:04.291449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:49:53.513521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214771+0000","last_change":"2023-09-29T23:05:04.213683+0000","last_active":"2023-09-29T23:05:04.214771+0000","last_peered":"2023-09-29T23:05:04.214771+0000","last_clean":"2023-09-29T23:05:04.214771+0000","last_became_active":"2023-09-29T23:05:04.213431+0000","last_became_peered":"2023-09-29T23:05:04.213431+0000","last_unstale":"2023-09-29T23:05:04.214771+0000","last_undegraded":"2023-09-29T23:05:04.214771+0000","last_fullsized":"2023-09-29T23:05:04.214771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:21:34.691582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.256718+0000","last_change":"2023-09-29T23:05:03.859535+0000","last_active":"2023-09-29T23:05:04.256718+0000","last_peered":"2023-09-29T23:05:04.256718+0000","last_clean":"2023-09-29T23:05:04.256718+0000","last_became_active":"2023-09-29T23:05:03.858960+0000","last_became_peered":"2023-09-29T23:05:03.858960+0000","last_unstale":"2023-09-29T23:05:04.256718+0000","last_undegraded":"2023-09-29T23:05:04.256718+0000","last_fullsized":"2023-09-29T23:05:04.256718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195352+0000","last_change":"2023-09-29T23:05:03.857165+0000","last_active":"2023-09-29T23:05:04.195352+0000","last_peered":"2023-09-29T23:05:04.195352+0000","last_clean":"2023-09-29T23:05:04.195352+0000","last_became_active":"2023-09-29T23:05:03.856861+0000","last_became_peered":"2023-09-29T23:05:03.856861+0000","last_unstale":"2023-09-29T23:05:04.195352+0000","last_undegraded":"2023-09-29T23:05:04.195352+0000","last_fullsized":"2023-09-29T23:05:04.195352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:36:14.657609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.285419+0000","last_change":"2023-09-29T23:05:04.285083+0000","last_active":"2023-09-29T23:05:04.285419+0000","last_peered":"2023-09-29T23:05:04.285419+0000","last_clean":"2023-09-29T23:05:04.285419+0000","last_became_active":"2023-09-29T23:05:04.284500+0000","last_became_peered":"2023-09-29T23:05:04.284500+0000","last_unstale":"2023-09-29T23:05:04.285419+0000","last_undegraded":"2023-09-29T23:05:04.285419+0000","last_fullsized":"2023-09-29T23:05:04.285419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:31:53.623960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195485+0000","last_change":"2023-09-29T23:05:03.856407+0000","last_active":"2023-09-29T23:05:04.195485+0000","last_peered":"2023-09-29T23:05:04.195485+0000","last_clean":"2023-09-29T23:05:04.195485+0000","last_became_active":"2023-09-29T23:05:03.855984+0000","last_became_peered":"2023-09-29T23:05:03.855984+0000","last_unstale":"2023-09-29T23:05:04.195485+0000","last_undegraded":"2023-09-29T23:05:04.195485+0000","last_fullsized":"2023-09-29T23:05:04.195485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:46:25.574473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251869+0000","last_change":"2023-09-29T23:05:04.247011+0000","last_active":"2023-09-29T23:05:04.251869+0000","last_peered":"2023-09-29T23:05:04.251869+0000","last_clean":"2023-09-29T23:05:04.251869+0000","last_became_active":"2023-09-29T23:05:04.240380+0000","last_became_peered":"2023-09-29T23:05:04.240380+0000","last_unstale":"2023-09-29T23:05:04.251869+0000","last_undegraded":"2023-09-29T23:05:04.251869+0000","last_fullsized":"2023-09-29T23:05:04.251869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:21:34.691582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.277505+0000","last_change":"2023-09-29T23:05:04.263213+0000","last_active":"2023-09-29T23:05:04.277505+0000","last_peered":"2023-09-29T23:05:04.277505+0000","last_clean":"2023-09-29T23:05:04.277505+0000","last_became_active":"2023-09-29T23:05:04.234635+0000","last_became_peered":"2023-09-29T23:05:04.234635+0000","last_unstale":"2023-09-29T23:05:04.277505+0000","last_undegraded":"2023-09-29T23:05:04.277505+0000","last_fullsized":"2023-09-29T23:05:04.277505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:16:13.607977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.202319+0000","last_change":"2023-09-29T23:05:03.883153+0000","last_active":"2023-09-29T23:05:04.202319+0000","last_peered":"2023-09-29T23:05:04.202319+0000","last_clean":"2023-09-29T23:05:04.202319+0000","last_became_active":"2023-09-29T23:05:03.880964+0000","last_became_peered":"2023-09-29T23:05:03.880964+0000","last_unstale":"2023-09-29T23:05:04.202319+0000","last_undegraded":"2023-09-29T23:05:04.202319+0000","last_fullsized":"2023-09-29T23:05:04.202319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:15:36.235024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214877+0000","last_change":"2023-09-29T23:05:04.213784+0000","last_active":"2023-09-29T23:05:04.214877+0000","last_peered":"2023-09-29T23:05:04.214877+0000","last_clean":"2023-09-29T23:05:04.214877+0000","last_became_active":"2023-09-29T23:05:04.213499+0000","last_became_peered":"2023-09-29T23:05:04.213499+0000","last_unstale":"2023-09-29T23:05:04.214877+0000","last_undegraded":"2023-09-29T23:05:04.214877+0000","last_fullsized":"2023-09-29T23:05:04.214877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:57:25.282750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.191084+0000","last_change":"2023-09-29T23:05:03.865070+0000","last_active":"2023-09-29T23:05:04.191084+0000","last_peered":"2023-09-29T23:05:04.191084+0000","last_clean":"2023-09-29T23:05:04.191084+0000","last_became_active":"2023-09-29T23:05:03.859573+0000","last_became_peered":"2023-09-29T23:05:03.859573+0000","last_unstale":"2023-09-29T23:05:04.191084+0000","last_undegraded":"2023-09-29T23:05:04.191084+0000","last_fullsized":"2023-09-29T23:05:04.191084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251877+0000","last_change":"2023-09-29T23:05:04.247674+0000","last_active":"2023-09-29T23:05:04.251877+0000","last_peered":"2023-09-29T23:05:04.251877+0000","last_clean":"2023-09-29T23:05:04.251877+0000","last_became_active":"2023-09-29T23:05:04.242811+0000","last_became_peered":"2023-09-29T23:05:04.242811+0000","last_unstale":"2023-09-29T23:05:04.251877+0000","last_undegraded":"2023-09-29T23:05:04.251877+0000","last_fullsized":"2023-09-29T23:05:04.251877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:03:27.134395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.288568+0000","last_change":"2023-09-29T23:05:03.857474+0000","last_active":"2023-09-29T23:05:04.288568+0000","last_peered":"2023-09-29T23:05:04.288568+0000","last_clean":"2023-09-29T23:05:04.288568+0000","last_became_active":"2023-09-29T23:05:03.857167+0000","last_became_peered":"2023-09-29T23:05:03.857167+0000","last_unstale":"2023-09-29T23:05:04.288568+0000","last_undegraded":"2023-09-29T23:05:04.288568+0000","last_fullsized":"2023-09-29T23:05:04.288568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:31.923909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.217544+0000","last_change":"2023-09-29T23:05:04.217335+0000","last_active":"2023-09-29T23:05:04.217544+0000","last_peered":"2023-09-29T23:05:04.217544+0000","last_clean":"2023-09-29T23:05:04.217544+0000","last_became_active":"2023-09-29T23:05:04.217102+0000","last_became_peered":"2023-09-29T23:05:04.217102+0000","last_unstale":"2023-09-29T23:05:04.217544+0000","last_undegraded":"2023-09-29T23:05:04.217544+0000","last_fullsized":"2023-09-29T23:05:04.217544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:44:09.407881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289348+0000","last_change":"2023-09-29T23:05:03.888717+0000","last_active":"2023-09-29T23:05:04.289348+0000","last_peered":"2023-09-29T23:05:04.289348+0000","last_clean":"2023-09-29T23:05:04.289348+0000","last_became_active":"2023-09-29T23:05:03.888471+0000","last_became_peered":"2023-09-29T23:05:03.888471+0000","last_unstale":"2023-09-29T23:05:04.289348+0000","last_undegraded":"2023-09-29T23:05:04.289348+0000","last_fullsized":"2023-09-29T23:05:04.289348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.245628+0000","last_change":"2023-09-29T23:05:04.245495+0000","last_active":"2023-09-29T23:05:04.245628+0000","last_peered":"2023-09-29T23:05:04.245628+0000","last_clean":"2023-09-29T23:05:04.245628+0000","last_became_active":"2023-09-29T23:05:04.245132+0000","last_became_peered":"2023-09-29T23:05:04.245132+0000","last_unstale":"2023-09-29T23:05:04.245628+0000","last_undegraded":"2023-09-29T23:05:04.245628+0000","last_fullsized":"2023-09-29T23:05:04.245628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:32.935665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.252903+0000","last_change":"2023-09-29T23:05:03.860597+0000","last_active":"2023-09-29T23:05:04.252903+0000","last_peered":"2023-09-29T23:05:04.252903+0000","last_clean":"2023-09-29T23:05:04.252903+0000","last_became_active":"2023-09-29T23:05:03.858980+0000","last_became_peered":"2023-09-29T23:05:03.858980+0000","last_unstale":"2023-09-29T23:05:04.252903+0000","last_undegraded":"2023-09-29T23:05:04.252903+0000","last_fullsized":"2023-09-29T23:05:04.252903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.286518+0000","last_change":"2023-09-29T23:05:04.285898+0000","last_active":"2023-09-29T23:05:04.286518+0000","last_peered":"2023-09-29T23:05:04.286518+0000","last_clean":"2023-09-29T23:05:04.286518+0000","last_became_active":"2023-09-29T23:05:04.281563+0000","last_became_peered":"2023-09-29T23:05:04.281563+0000","last_unstale":"2023-09-29T23:05:04.286518+0000","last_undegraded":"2023-09-29T23:05:04.286518+0000","last_fullsized":"2023-09-29T23:05:04.286518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:01:55.739719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289877+0000","last_change":"2023-09-29T23:05:03.852972+0000","last_active":"2023-09-29T23:05:04.289877+0000","last_peered":"2023-09-29T23:05:04.289877+0000","last_clean":"2023-09-29T23:05:04.289877+0000","last_became_active":"2023-09-29T23:05:03.852482+0000","last_became_peered":"2023-09-29T23:05:03.852482+0000","last_unstale":"2023-09-29T23:05:04.289877+0000","last_undegraded":"2023-09-29T23:05:04.289877+0000","last_fullsized":"2023-09-29T23:05:04.289877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:00.205324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.252754+0000","last_change":"2023-09-29T23:05:04.250548+0000","last_active":"2023-09-29T23:05:04.252754+0000","last_peered":"2023-09-29T23:05:04.252754+0000","last_clean":"2023-09-29T23:05:04.252754+0000","last_became_active":"2023-09-29T23:05:04.244183+0000","last_became_peered":"2023-09-29T23:05:04.244183+0000","last_unstale":"2023-09-29T23:05:04.252754+0000","last_undegraded":"2023-09-29T23:05:04.252754+0000","last_fullsized":"2023-09-29T23:05:04.252754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:18.681401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.208590+0000","last_change":"2023-09-29T23:05:03.865954+0000","last_active":"2023-09-29T23:05:04.208590+0000","last_peered":"2023-09-29T23:05:04.208590+0000","last_clean":"2023-09-29T23:05:04.208590+0000","last_became_active":"2023-09-29T23:05:03.862839+0000","last_became_peered":"2023-09-29T23:05:03.862839+0000","last_unstale":"2023-09-29T23:05:04.208590+0000","last_undegraded":"2023-09-29T23:05:04.208590+0000","last_fullsized":"2023-09-29T23:05:04.208590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:51:59.213175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215358+0000","last_change":"2023-09-29T23:05:04.215287+0000","last_active":"2023-09-29T23:05:04.215358+0000","last_peered":"2023-09-29T23:05:04.215358+0000","last_clean":"2023-09-29T23:05:04.215358+0000","last_became_active":"2023-09-29T23:05:04.214923+0000","last_became_peered":"2023-09-29T23:05:04.214923+0000","last_unstale":"2023-09-29T23:05:04.215358+0000","last_undegraded":"2023-09-29T23:05:04.215358+0000","last_fullsized":"2023-09-29T23:05:04.215358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:33:35.631951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.221893+0000","last_change":"2023-09-29T23:05:03.850861+0000","last_active":"2023-09-29T23:05:04.221893+0000","last_peered":"2023-09-29T23:05:04.221893+0000","last_clean":"2023-09-29T23:05:04.221893+0000","last_became_active":"2023-09-29T23:05:03.848098+0000","last_became_peered":"2023-09-29T23:05:03.848098+0000","last_unstale":"2023-09-29T23:05:04.221893+0000","last_undegraded":"2023-09-29T23:05:04.221893+0000","last_fullsized":"2023-09-29T23:05:04.221893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":55,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795992,"kb_used_data":92903396,"kb_used_omap":345,"kb_used_meta":0,"kb_avail":92903388,"statfs":{"total":95948165120,"available":95133069312,"internally_reserved":8192,"allocated":95133077504,"data_stored":95133077504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":353376,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":21,"commit_latency_ns":0,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":37,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797036,"kb_used_data":92902344,"kb_used_omap":309,"kb_used_meta":0,"kb_avail":92902344,"statfs":{"total":95948165120,"available":95132000256,"internally_reserved":0,"allocated":95132000256,"data_stored":95132000256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":317420,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":20,"commit_latency_ns":0,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":59,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797156,"kb_used_data":92902224,"kb_used_omap":423,"kb_used_meta":0,"kb_avail":92902224,"statfs":{"total":95948165120,"available":95131877376,"internally_reserved":0,"allocated":95131877376,"data_stored":95131877376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":433583,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":15,"commit_latency_ns":0,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":59,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796084,"kb_used_data":92903296,"kb_used_omap":371,"kb_used_meta":0,"kb_avail":92903296,"statfs":{"total":95948165120,"available":95132975104,"internally_reserved":0,"allocated":95132975104,"data_stored":95132975104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":380625,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":43,"commit_latency_ns":0,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]}],"pool_statfs":[]}} 2023-09-29T23:05:11.869 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-29T23:05:11.869 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-29T23:05:11.869 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-29T23:05:11.870 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-29T23:05:11.870 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-29T23:05:11.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff51566e700 1 Processor -- start 2023-09-29T23:05:11.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff51566e700 1 -- start start 2023-09-29T23:05:11.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff51566e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff5101473f0 0x7ff5100a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:11.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff51566e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff510147a70 0x7ff510139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:11.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff51566e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5101477c0 con 0x7ff510147e70 2023-09-29T23:05:11.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff51566e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5100a6d60 con 0x7ff510147a70 2023-09-29T23:05:11.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff51566e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5100a7020 con 0x7ff5101473f0 2023-09-29T23:05:11.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff50f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff510147a70 0x7ff510139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:11.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff50f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff510147a70 0x7ff510139bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40840/0 (socket says 172.21.15.115:40840) 2023-09-29T23:05:11.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff50f7fe700 1 -- 172.21.15.115:0/1428621126 learned_addr learned my addr 172.21.15.115:0/1428621126 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:11.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff50ffff700 1 --2- 172.21.15.115:0/1428621126 >> v2:172.21.15.156:3300/0 conn(0x7ff5101473f0 0x7ff5100a8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:11.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff50f7fe700 1 -- 172.21.15.115:0/1428621126 >> v2:172.21.15.156:3300/0 conn(0x7ff5101473f0 msgr2=0x7ff5100a8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:11.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff50f7fe700 1 --2- 172.21.15.115:0/1428621126 >> v2:172.21.15.156:3300/0 conn(0x7ff5101473f0 0x7ff5100a8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:11.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff50f7fe700 1 -- 172.21.15.115:0/1428621126 >> v1:172.21.15.156:6789/0 conn(0x7ff510147e70 legacy=0x7ff51009db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:11.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff50effd700 1 -- 172.21.15.115:0/1428621126 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333915317 0 0) 0x7ff5101477c0 con 0x7ff510147e70 2023-09-29T23:05:11.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff50f7fe700 1 -- 172.21.15.115:0/1428621126 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5100a6940 con 0x7ff510147a70 2023-09-29T23:05:11.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.973+0000 7ff50f7fe700 1 --2- 172.21.15.115:0/1428621126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff510147a70 0x7ff510139bd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff51006a230 tx=0x7ff500009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda59e24f1d06b99 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:11.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.977+0000 7ff50effd700 1 -- 172.21.15.115:0/1428621126 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500009e70 con 0x7ff510147a70 2023-09-29T23:05:11.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.977+0000 7ff50effd700 1 -- 172.21.15.115:0/1428621126 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50000b8f0 con 0x7ff510147a70 2023-09-29T23:05:11.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.977+0000 7ff50effd700 1 -- 172.21.15.115:0/1428621126 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50000bc90 con 0x7ff510147a70 2023-09-29T23:05:11.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.977+0000 7ff51566e700 1 -- 172.21.15.115:0/1428621126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff510147a70 msgr2=0x7ff510139bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:11.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.977+0000 7ff51566e700 1 --2- 172.21.15.115:0/1428621126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff510147a70 0x7ff510139bd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff51006a230 tx=0x7ff500009250 comp rx=0 tx=0).stop 2023-09-29T23:05:11.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.977+0000 7ff51566e700 1 -- 172.21.15.115:0/1428621126 shutdown_connections 2023-09-29T23:05:11.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.977+0000 7ff51566e700 1 --2- 172.21.15.115:0/1428621126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff510147a70 0x7ff510139bd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:11.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.977+0000 7ff51566e700 1 --2- 172.21.15.115:0/1428621126 >> v2:172.21.15.156:3300/0 conn(0x7ff5101473f0 0x7ff5100a8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:11.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.977+0000 7ff51566e700 1 -- 172.21.15.115:0/1428621126 >> 172.21.15.115:0/1428621126 conn(0x7ff5100b6c10 msgr2=0x7ff510067bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:11.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.977+0000 7ff51566e700 1 -- 172.21.15.115:0/1428621126 shutdown_connections 2023-09-29T23:05:11.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.977+0000 7ff51566e700 1 -- 172.21.15.115:0/1428621126 wait complete. 2023-09-29T23:05:11.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.977+0000 7ff51566e700 1 Processor -- start 2023-09-29T23:05:11.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.977+0000 7ff51566e700 1 -- start start 2023-09-29T23:05:11.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff51566e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5101473f0 0x7ff510156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:11.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff51566e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff510147a70 0x7ff510149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:11.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff51566e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff510147e70 0x7ff510152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:11.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff51566e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5101570d0 con 0x7ff5101473f0 2023-09-29T23:05:11.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff51566e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff510157390 con 0x7ff510147e70 2023-09-29T23:05:11.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff51566e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff510157650 con 0x7ff510147a70 2023-09-29T23:05:11.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff50ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5101473f0 0x7ff510156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:11.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff50ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5101473f0 0x7ff510156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40848/0 (socket says 172.21.15.115:40848) 2023-09-29T23:05:11.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff50ffff700 1 -- 172.21.15.115:0/3639234278 learned_addr learned my addr 172.21.15.115:0/3639234278 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:11.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff50f7fe700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff510147a70 0x7ff510149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:11.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff514e6d700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff510147e70 0x7ff510152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:11.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff50f7fe700 1 -- 172.21.15.115:0/3639234278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff510147e70 msgr2=0x7ff510152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:11.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff50f7fe700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff510147e70 0x7ff510152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:11.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff50f7fe700 1 -- 172.21.15.115:0/3639234278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5101473f0 msgr2=0x7ff510156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:11.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff50f7fe700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5101473f0 0x7ff510156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:11.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff50f7fe700 1 -- 172.21.15.115:0/3639234278 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000094f0 con 0x7ff510147a70 2023-09-29T23:05:11.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff50ffff700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5101473f0 0x7ff510156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:11.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff50f7fe700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff510147a70 0x7ff510149830 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff510144e80 tx=0x7ff500017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:11.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff4f7fff700 1 -- 172.21.15.115:0/3639234278 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50000bc70 con 0x7ff510147a70 2023-09-29T23:05:11.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff4f7fff700 1 -- 172.21.15.115:0/3639234278 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50001a420 con 0x7ff510147a70 2023-09-29T23:05:11.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff51566e700 1 -- 172.21.15.115:0/3639234278 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5100a4450 con 0x7ff510147a70 2023-09-29T23:05:11.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff4f7fff700 1 -- 172.21.15.115:0/3639234278 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50001a7c0 con 0x7ff510147a70 2023-09-29T23:05:11.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff51566e700 1 -- 172.21.15.115:0/3639234278 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51006c330 con 0x7ff510147a70 2023-09-29T23:05:11.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.981+0000 7ff51566e700 1 -- 172.21.15.115:0/3639234278 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51004be00 con 0x7ff510147a70 2023-09-29T23:05:11.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.985+0000 7ff4f7fff700 1 -- 172.21.15.115:0/3639234278 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7ff50001abb0 con 0x7ff510147a70 2023-09-29T23:05:11.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.985+0000 7ff4f7fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:11.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.985+0000 7ff4f7fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:11.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.985+0000 7ff4f7fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:11.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.985+0000 7ff4f7fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:11.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.985+0000 7ff4f7fff700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff4fc08e8b0 0x7ff4fc090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:11.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.985+0000 7ff4f7fff700 1 -- 172.21.15.115:0/3639234278 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7ff5000b5f90 con 0x7ff510147a70 2023-09-29T23:05:11.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.985+0000 7ff50ffff700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff4fc08e8b0 0x7ff4fc090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:11.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.989+0000 7ff50ffff700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff4fc08e8b0 0x7ff4fc090d60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff5040114e0 tx=0x7ff5040091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:11.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:11.993+0000 7ff4f7fff700 1 -- 172.21.15.115:0/3639234278 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff500086a50 con 0x7ff510147a70 2023-09-29T23:05:12.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.193+0000 7ff51566e700 1 -- 172.21.15.115:0/3639234278 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff51013a110 con 0x7ff510147a70 2023-09-29T23:05:12.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.205+0000 7ff4f7fff700 1 -- 172.21.15.115:0/3639234278 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+230617 (secure 0 0 0) 0x7ff500015020 con 0x7ff510147a70 2023-09-29T23:05:12.209 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:12.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.209+0000 7ff51566e700 10 mgrc shutdown 2023-09-29T23:05:12.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.209+0000 7ff51566e700 1 -- 172.21.15.115:0/3639234278 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff4fc08e8b0 msgr2=0x7ff4fc090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.209+0000 7ff51566e700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff4fc08e8b0 0x7ff4fc090d60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff5040114e0 tx=0x7ff5040091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.209+0000 7ff51566e700 1 -- 172.21.15.115:0/3639234278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff510147a70 msgr2=0x7ff510149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.209+0000 7ff51566e700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff510147a70 0x7ff510149830 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff510144e80 tx=0x7ff500017000 comp rx=0 tx=0).stop 2023-09-29T23:05:12.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.209+0000 7ff51566e700 1 -- 172.21.15.115:0/3639234278 shutdown_connections 2023-09-29T23:05:12.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.209+0000 7ff51566e700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff510147e70 0x7ff510152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.209+0000 7ff51566e700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff510147a70 0x7ff510149830 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.209+0000 7ff51566e700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff4fc08e8b0 0x7ff4fc090d60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.209+0000 7ff51566e700 1 --2- 172.21.15.115:0/3639234278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5101473f0 0x7ff510156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.209+0000 7ff51566e700 1 -- 172.21.15.115:0/3639234278 >> 172.21.15.115:0/3639234278 conn(0x7ff5100b6c10 msgr2=0x7ff51009ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:12.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.209+0000 7ff51566e700 1 -- 172.21.15.115:0/3639234278 shutdown_connections 2023-09-29T23:05:12.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.209+0000 7ff51566e700 1 -- 172.21.15.115:0/3639234278 wait complete. 2023-09-29T23:05:12.223 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":26644},{"type":"v1","addr":"172.21.15.156:6825","nonce":26644}]},"active_addr":"172.21.15.156:6825/26644","active_change":"2023-09-29T23:04:52.824659+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4104,"name":"z","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4113,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":2692590723}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":1231046797}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":3627457873}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":1552477638}]}]} 2023-09-29T23:05:12.229 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-29T23:05:12.229 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-29T23:05:12.229 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:05:12.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50b2131700 1 Processor -- start 2023-09-29T23:05:12.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50b2131700 1 -- start start 2023-09-29T23:05:12.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50b2131700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f50ac09b040 0x7f50ac0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50b2131700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ac06fbe0 con 0x7f50ac0a4d40 2023-09-29T23:05:12.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50b2131700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ac09b660 con 0x7f50ac0a3bd0 2023-09-29T23:05:12.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50b2131700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50ac141910 con 0x7f50ac09b040 2023-09-29T23:05:12.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50ab7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f50ac0a4d40 0x7f50ac147450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41680/0 (socket says 172.21.15.115:41680) 2023-09-29T23:05:12.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50ab7fe700 1 -- 172.21.15.115:0/3838740130 learned_addr learned my addr 172.21.15.115:0/3838740130 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:12.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50aaffd700 1 --2- 172.21.15.115:0/3838740130 >> v2:172.21.15.156:3300/0 conn(0x7f50ac09b040 0x7f50ac0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50aa7fc700 1 -- 172.21.15.115:0/3838740130 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047699862 0 0) 0x7f50ac06fbe0 con 0x7f50ac0a4d40 2023-09-29T23:05:12.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50aa7fc700 1 -- 172.21.15.115:0/3838740130 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5094003570 con 0x7f50ac0a4d40 2023-09-29T23:05:12.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50aaffd700 1 -- 172.21.15.115:0/3838740130 >> v1:172.21.15.156:6789/0 conn(0x7f50ac0a3bd0 legacy=0x7f50ac14e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50aaffd700 1 -- 172.21.15.115:0/3838740130 >> v1:172.21.15.115:6789/0 conn(0x7f50ac0a4d40 legacy=0x7f50ac147450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50aaffd700 1 -- 172.21.15.115:0/3838740130 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ac0a5110 con 0x7f50ac09b040 2023-09-29T23:05:12.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50aaffd700 1 --2- 172.21.15.115:0/3838740130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50ac09b040 0x7f50ac0a3690 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009e60 tx=0x7f50a4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68633c9af4b48920 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50aa7fc700 1 -- 172.21.15.115:0/3838740130 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a400e070 con 0x7f50ac09b040 2023-09-29T23:05:12.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50aa7fc700 1 -- 172.21.15.115:0/3838740130 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a400bb60 con 0x7f50ac09b040 2023-09-29T23:05:12.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50aa7fc700 1 -- 172.21.15.115:0/3838740130 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4012430 con 0x7f50ac09b040 2023-09-29T23:05:12.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50b2131700 1 -- 172.21.15.115:0/3838740130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50ac09b040 msgr2=0x7f50ac0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50b2131700 1 --2- 172.21.15.115:0/3838740130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50ac09b040 0x7f50ac0a3690 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009e60 tx=0x7f50a4009780 comp rx=0 tx=0).stop 2023-09-29T23:05:12.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50b2131700 1 -- 172.21.15.115:0/3838740130 shutdown_connections 2023-09-29T23:05:12.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50b2131700 1 --2- 172.21.15.115:0/3838740130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50ac09b040 0x7f50ac0a3690 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009e60 tx=0x7f50a4009780 comp rx=0 tx=0).stop 2023-09-29T23:05:12.338 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50b2131700 1 -- 172.21.15.115:0/3838740130 >> 172.21.15.115:0/3838740130 conn(0x7f50ac0695c0 msgr2=0x7f50ac0699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:12.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50b2131700 1 -- 172.21.15.115:0/3838740130 shutdown_connections 2023-09-29T23:05:12.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.333+0000 7f50b2131700 1 -- 172.21.15.115:0/3838740130 wait complete. 2023-09-29T23:05:12.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50b2131700 1 Processor -- start 2023-09-29T23:05:12.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50b2131700 1 -- start start 2023-09-29T23:05:12.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50b2131700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50ac0a3bd0 0x7f50ac0a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50b2131700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50ac0a4d40 0x7f50ac153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50b2131700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50ac13f0f0 0x7f50ac1540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50b2131700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac154620 con 0x7f50ac0a4d40 2023-09-29T23:05:12.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50b2131700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac09df80 con 0x7f50ac0a3bd0 2023-09-29T23:05:12.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50b2131700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac09dc40 con 0x7f50ac13f0f0 2023-09-29T23:05:12.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50aaffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50ac0a4d40 0x7f50ac153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50abfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50ac13f0f0 0x7f50ac1540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50abfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50ac13f0f0 0x7f50ac1540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33180/0 (socket says 172.21.15.115:33180) 2023-09-29T23:05:12.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50abfff700 1 -- 172.21.15.115:0/1458260668 learned_addr learned my addr 172.21.15.115:0/1458260668 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:12.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50ab7fe700 1 --2- 172.21.15.115:0/1458260668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50ac0a3bd0 0x7f50ac0a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50abfff700 1 -- 172.21.15.115:0/1458260668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50ac0a3bd0 msgr2=0x7f50ac0a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50abfff700 1 --2- 172.21.15.115:0/1458260668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50ac0a3bd0 0x7f50ac0a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50abfff700 1 -- 172.21.15.115:0/1458260668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50ac0a4d40 msgr2=0x7f50ac153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50abfff700 1 --2- 172.21.15.115:0/1458260668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50ac0a4d40 0x7f50ac153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50abfff700 1 -- 172.21.15.115:0/1458260668 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a4009a20 con 0x7f50ac13f0f0 2023-09-29T23:05:12.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.337+0000 7f50abfff700 1 --2- 172.21.15.115:0/1458260668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50ac13f0f0 0x7f50ac1540e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f509c00c560 tx=0x7f509c007ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.341+0000 7f50937fe700 1 -- 172.21.15.115:0/1458260668 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c011590 con 0x7f50ac13f0f0 2023-09-29T23:05:12.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.341+0000 7f50937fe700 1 -- 172.21.15.115:0/1458260668 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c0116f0 con 0x7f50ac13f0f0 2023-09-29T23:05:12.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.341+0000 7f50b2131700 1 -- 172.21.15.115:0/1458260668 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ac154af0 con 0x7f50ac13f0f0 2023-09-29T23:05:12.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.341+0000 7f50937fe700 1 -- 172.21.15.115:0/1458260668 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c011ab0 con 0x7f50ac13f0f0 2023-09-29T23:05:12.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.341+0000 7f50b2131700 1 -- 172.21.15.115:0/1458260668 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ac06c7c0 con 0x7f50ac13f0f0 2023-09-29T23:05:12.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.341+0000 7f50b2131700 1 -- 172.21.15.115:0/1458260668 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ac13f530 con 0x7f50ac13f0f0 2023-09-29T23:05:12.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.341+0000 7f50937fe700 1 -- 172.21.15.115:0/1458260668 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f509c01b3b0 con 0x7f50ac13f0f0 2023-09-29T23:05:12.344 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.341+0000 7f50937fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:12.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.345+0000 7f50937fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:12.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.345+0000 7f50937fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:12.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.345+0000 7f50937fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:12.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.345+0000 7f50937fe700 1 --2- 172.21.15.115:0/1458260668 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f509808e8b0 0x7f5098090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.345+0000 7f50937fe700 1 -- 172.21.15.115:0/1458260668 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f509c0b3c00 con 0x7f50ac13f0f0 2023-09-29T23:05:12.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.345+0000 7f50ab7fe700 1 --2- 172.21.15.115:0/1458260668 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f509808e8b0 0x7f5098090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.345+0000 7f50ab7fe700 1 --2- 172.21.15.115:0/1458260668 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f509808e8b0 0x7f5098090d60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f50a0007fd0 tx=0x7f50a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.349+0000 7f50937fe700 1 -- 172.21.15.115:0/1458260668 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f50ac13f530 con 0x7f50ac13f0f0 2023-09-29T23:05:12.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.509+0000 7f50b2131700 1 -- 172.21.15.115:0/1458260668 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50ac13f530 con 0x7f50ac13f0f0 2023-09-29T23:05:12.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.513+0000 7f50937fe700 1 -- 172.21.15.115:0/1458260668 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12206 (secure 0 0 0) 0x7f50ac13f530 con 0x7f50ac13f0f0 2023-09-29T23:05:12.514 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:12.514 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":20,"fsid":"593687ae-01c7-4a32-a91e-931db75fb751","created":"2023-09-29T23:04:48.574873+0000","modified":"2023-09-29T23:05:05.189678+0000","last_up_change":"2023-09-29T23:04:53.614158+0000","last_in_change":"2023-09-29T23:04:50.489116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-29T23:04:54.900033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-29T23:04:58.342574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-29T23:05:02.595115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-29T23:05:03.183110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9da0e8c9-ea18-4691-87ef-fbf5502845a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":26662},{"type":"v1","addr":"172.21.15.115:6801","nonce":26662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":26662},{"type":"v1","addr":"172.21.15.115:6803","nonce":26662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":26662},{"type":"v1","addr":"172.21.15.115:6807","nonce":26662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":26662},{"type":"v1","addr":"172.21.15.115:6805","nonce":26662}]},"public_addr":"172.21.15.115:6801/26662","cluster_addr":"172.21.15.115:6803/26662","heartbeat_back_addr":"172.21.15.115:6807/26662","heartbeat_front_addr":"172.21.15.115:6805/26662","state":["exists","up"]},{"osd":1,"uuid":"eaaa380c-73da-4075-992d-ab16b36d8ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":26874},{"type":"v1","addr":"172.21.15.156:6801","nonce":26874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":26874},{"type":"v1","addr":"172.21.15.156:6803","nonce":26874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":26874},{"type":"v1","addr":"172.21.15.156:6807","nonce":26874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":26874},{"type":"v1","addr":"172.21.15.156:6805","nonce":26874}]},"public_addr":"172.21.15.156:6801/26874","cluster_addr":"172.21.15.156:6803/26874","heartbeat_back_addr":"172.21.15.156:6807/26874","heartbeat_front_addr":"172.21.15.156:6805/26874","state":["exists","up"]},{"osd":2,"uuid":"01e8286e-30af-41c7-bcd1-c4545f9f0a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":26873},{"type":"v1","addr":"172.21.15.156:6809","nonce":26873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":26873},{"type":"v1","addr":"172.21.15.156:6811","nonce":26873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":26873},{"type":"v1","addr":"172.21.15.156:6817","nonce":26873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":26873},{"type":"v1","addr":"172.21.15.156:6813","nonce":26873}]},"public_addr":"172.21.15.156:6809/26873","cluster_addr":"172.21.15.156:6811/26873","heartbeat_back_addr":"172.21.15.156:6817/26873","heartbeat_front_addr":"172.21.15.156:6813/26873","state":["exists","up"]},{"osd":3,"uuid":"4f6a1234-5ac6-43b0-baaa-3567ab7c73a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6815","nonce":26875},{"type":"v1","addr":"172.21.15.156:6816","nonce":26875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":26875},{"type":"v1","addr":"172.21.15.156:6819","nonce":26875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":26875},{"type":"v1","addr":"172.21.15.156:6823","nonce":26875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":26875},{"type":"v1","addr":"172.21.15.156:6821","nonce":26875}]},"public_addr":"172.21.15.156:6816/26875","cluster_addr":"172.21.15.156:6819/26875","heartbeat_back_addr":"172.21.15.156:6823/26875","heartbeat_front_addr":"172.21.15.156:6821/26875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.582513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.686413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:05:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.513+0000 7f50b2131700 10 mgrc shutdown 2023-09-29T23:05:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.517+0000 7f50b2131700 1 -- 172.21.15.115:0/1458260668 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f509808e8b0 msgr2=0x7f5098090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.517+0000 7f50b2131700 1 --2- 172.21.15.115:0/1458260668 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f509808e8b0 0x7f5098090d60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f50a0007fd0 tx=0x7f50a0009040 comp rx=0 tx=0).stop 2023-09-29T23:05:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.517+0000 7f50b2131700 1 -- 172.21.15.115:0/1458260668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50ac13f0f0 msgr2=0x7f50ac1540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.517+0000 7f50b2131700 1 --2- 172.21.15.115:0/1458260668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50ac13f0f0 0x7f50ac1540e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f509c00c560 tx=0x7f509c007ef0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.517+0000 7f50b2131700 1 -- 172.21.15.115:0/1458260668 shutdown_connections 2023-09-29T23:05:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.517+0000 7f50b2131700 1 --2- 172.21.15.115:0/1458260668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f50ac13f0f0 0x7f50ac1540e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.517+0000 7f50b2131700 1 --2- 172.21.15.115:0/1458260668 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f509808e8b0 0x7f5098090d60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.517+0000 7f50b2131700 1 --2- 172.21.15.115:0/1458260668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50ac0a4d40 0x7f50ac153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.517+0000 7f50b2131700 1 --2- 172.21.15.115:0/1458260668 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50ac0a3bd0 0x7f50ac0a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.517+0000 7f50b2131700 1 -- 172.21.15.115:0/1458260668 >> 172.21.15.115:0/1458260668 conn(0x7f50ac0695c0 msgr2=0x7f50ac067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:12.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.517+0000 7f50b2131700 1 -- 172.21.15.115:0/1458260668 shutdown_connections 2023-09-29T23:05:12.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.517+0000 7f50b2131700 1 -- 172.21.15.115:0/1458260668 wait complete. 2023-09-29T23:05:12.533 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-29T23:05:12.533 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:05:12.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc665d1700 1 Processor -- start 2023-09-29T23:05:12.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc665d1700 1 -- start start 2023-09-29T23:05:12.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc665d1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcc60067b60 0x7fcc600a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc665d1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc600a4370 0x7fcc6006e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc665d1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc600a4830 con 0x7fcc6006eda0 2023-09-29T23:05:12.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc665d1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6006f200 con 0x7fcc60067b60 2023-09-29T23:05:12.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc665d1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc60067f30 con 0x7fcc600a4370 2023-09-29T23:05:12.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc64dce700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc600a4370 0x7fcc6006e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc65dd0700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fcc6006eda0 0x7fcc60143270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41684/0 (socket says 172.21.15.115:41684) 2023-09-29T23:05:12.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc65dd0700 1 -- 172.21.15.115:0/2778693658 learned_addr learned my addr 172.21.15.115:0/2778693658 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:12.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc655cf700 1 --2- 172.21.15.115:0/2778693658 >> v2:172.21.15.156:3300/0 conn(0x7fcc60067b60 0x7fcc600a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc53fff700 1 -- 172.21.15.115:0/2778693658 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092721130 0 0) 0x7fcc600a4830 con 0x7fcc6006eda0 2023-09-29T23:05:12.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc64dce700 1 -- 172.21.15.115:0/2778693658 >> v2:172.21.15.156:3300/0 conn(0x7fcc60067b60 msgr2=0x7fcc600a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:12.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc64dce700 1 --2- 172.21.15.115:0/2778693658 >> v2:172.21.15.156:3300/0 conn(0x7fcc60067b60 0x7fcc600a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc64dce700 1 -- 172.21.15.115:0/2778693658 >> v1:172.21.15.115:6789/0 conn(0x7fcc6006eda0 legacy=0x7fcc60143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc64dce700 1 -- 172.21.15.115:0/2778693658 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6006fa30 con 0x7fcc600a4370 2023-09-29T23:05:12.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc64dce700 1 --2- 172.21.15.115:0/2778693658 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc600a4370 0x7fcc6006e860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009e60 tx=0x7fcc5c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=704c569e06659f1b server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc53fff700 1 -- 172.21.15.115:0/2778693658 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c00e070 con 0x7fcc600a4370 2023-09-29T23:05:12.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc53fff700 1 -- 172.21.15.115:0/2778693658 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5c00bb60 con 0x7fcc600a4370 2023-09-29T23:05:12.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.633+0000 7fcc53fff700 1 -- 172.21.15.115:0/2778693658 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c012430 con 0x7fcc600a4370 2023-09-29T23:05:12.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.637+0000 7fcc665d1700 1 -- 172.21.15.115:0/2778693658 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc600a4370 msgr2=0x7fcc6006e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.637+0000 7fcc665d1700 1 --2- 172.21.15.115:0/2778693658 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc600a4370 0x7fcc6006e860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009e60 tx=0x7fcc5c009780 comp rx=0 tx=0).stop 2023-09-29T23:05:12.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.637+0000 7fcc665d1700 1 -- 172.21.15.115:0/2778693658 shutdown_connections 2023-09-29T23:05:12.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.637+0000 7fcc665d1700 1 --2- 172.21.15.115:0/2778693658 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc600a4370 0x7fcc6006e860 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.637+0000 7fcc665d1700 1 --2- 172.21.15.115:0/2778693658 >> v2:172.21.15.156:3300/0 conn(0x7fcc60067b60 0x7fcc600a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.637+0000 7fcc665d1700 1 -- 172.21.15.115:0/2778693658 >> 172.21.15.115:0/2778693658 conn(0x7fcc60068a40 msgr2=0x7fcc60068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:12.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.637+0000 7fcc665d1700 1 -- 172.21.15.115:0/2778693658 shutdown_connections 2023-09-29T23:05:12.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.637+0000 7fcc665d1700 1 -- 172.21.15.115:0/2778693658 wait complete. 2023-09-29T23:05:12.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.637+0000 7fcc665d1700 1 Processor -- start 2023-09-29T23:05:12.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.637+0000 7fcc665d1700 1 -- start start 2023-09-29T23:05:12.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.637+0000 7fcc665d1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc60067b60 0x7fcc60152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc665d1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc6006eda0 0x7fcc600b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc665d1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc600a4370 0x7fcc60134560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc665d1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6009e7b0 con 0x7fcc60067b60 2023-09-29T23:05:12.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc665d1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc60153360 con 0x7fcc600a4370 2023-09-29T23:05:12.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc665d1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc60153620 con 0x7fcc6006eda0 2023-09-29T23:05:12.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc655cf700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc60067b60 0x7fcc60152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc655cf700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc60067b60 0x7fcc60152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40858/0 (socket says 172.21.15.115:40858) 2023-09-29T23:05:12.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc64dce700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc6006eda0 0x7fcc600b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc655cf700 1 -- 172.21.15.115:0/3531967031 learned_addr learned my addr 172.21.15.115:0/3531967031 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:12.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc65dd0700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc600a4370 0x7fcc60134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc655cf700 1 -- 172.21.15.115:0/3531967031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc6006eda0 msgr2=0x7fcc600b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc655cf700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc6006eda0 0x7fcc600b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc655cf700 1 -- 172.21.15.115:0/3531967031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc600a4370 msgr2=0x7fcc60134560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc655cf700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc600a4370 0x7fcc60134560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc655cf700 1 -- 172.21.15.115:0/3531967031 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c009a20 con 0x7fcc60067b60 2023-09-29T23:05:12.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc65dd0700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc600a4370 0x7fcc60134560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:05:12.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc655cf700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc60067b60 0x7fcc60152b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400ec80 tx=0x7fcc540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc517fa700 1 -- 172.21.15.115:0/3531967031 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400c850 con 0x7fcc60067b60 2023-09-29T23:05:12.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc517fa700 1 -- 172.21.15.115:0/3531967031 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5400c9b0 con 0x7fcc60067b60 2023-09-29T23:05:12.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc665d1700 1 -- 172.21.15.115:0/3531967031 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc601530a0 con 0x7fcc60067b60 2023-09-29T23:05:12.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc517fa700 1 -- 172.21.15.115:0/3531967031 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400cd50 con 0x7fcc60067b60 2023-09-29T23:05:12.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc665d1700 1 -- 172.21.15.115:0/3531967031 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc600b3340 con 0x7fcc60067b60 2023-09-29T23:05:12.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.641+0000 7fcc665d1700 1 -- 172.21.15.115:0/3531967031 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6004be00 con 0x7fcc60067b60 2023-09-29T23:05:12.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.645+0000 7fcc517fa700 1 -- 172.21.15.115:0/3531967031 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fcc54013680 con 0x7fcc60067b60 2023-09-29T23:05:12.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.645+0000 7fcc517fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:12.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.645+0000 7fcc517fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:12.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.645+0000 7fcc517fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:12.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.645+0000 7fcc517fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:12.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.645+0000 7fcc517fa700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fcc4408e8b0 0x7fcc44090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.645+0000 7fcc517fa700 1 -- 172.21.15.115:0/3531967031 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fcc540b4a70 con 0x7fcc60067b60 2023-09-29T23:05:12.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.645+0000 7fcc64dce700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fcc4408e8b0 0x7fcc44090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.645+0000 7fcc64dce700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fcc4408e8b0 0x7fcc44090d60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcc600a6130 tx=0x7fcc5c019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.649+0000 7fcc517fa700 1 -- 172.21.15.115:0/3531967031 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcc54085530 con 0x7fcc60067b60 2023-09-29T23:05:12.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.809+0000 7fcc665d1700 1 -- 172.21.15.115:0/3531967031 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc6006e410 con 0x7fcc60067b60 2023-09-29T23:05:12.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc517fa700 1 -- 172.21.15.115:0/3531967031 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12206 (secure 0 0 0) 0x7fcc54021090 con 0x7fcc60067b60 2023-09-29T23:05:12.814 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:12.815 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":20,"fsid":"593687ae-01c7-4a32-a91e-931db75fb751","created":"2023-09-29T23:04:48.574873+0000","modified":"2023-09-29T23:05:05.189678+0000","last_up_change":"2023-09-29T23:04:53.614158+0000","last_in_change":"2023-09-29T23:04:50.489116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-29T23:04:54.900033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-29T23:04:58.342574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-29T23:05:02.595115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-29T23:05:03.183110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9da0e8c9-ea18-4691-87ef-fbf5502845a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":26662},{"type":"v1","addr":"172.21.15.115:6801","nonce":26662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":26662},{"type":"v1","addr":"172.21.15.115:6803","nonce":26662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":26662},{"type":"v1","addr":"172.21.15.115:6807","nonce":26662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":26662},{"type":"v1","addr":"172.21.15.115:6805","nonce":26662}]},"public_addr":"172.21.15.115:6801/26662","cluster_addr":"172.21.15.115:6803/26662","heartbeat_back_addr":"172.21.15.115:6807/26662","heartbeat_front_addr":"172.21.15.115:6805/26662","state":["exists","up"]},{"osd":1,"uuid":"eaaa380c-73da-4075-992d-ab16b36d8ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":26874},{"type":"v1","addr":"172.21.15.156:6801","nonce":26874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":26874},{"type":"v1","addr":"172.21.15.156:6803","nonce":26874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":26874},{"type":"v1","addr":"172.21.15.156:6807","nonce":26874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":26874},{"type":"v1","addr":"172.21.15.156:6805","nonce":26874}]},"public_addr":"172.21.15.156:6801/26874","cluster_addr":"172.21.15.156:6803/26874","heartbeat_back_addr":"172.21.15.156:6807/26874","heartbeat_front_addr":"172.21.15.156:6805/26874","state":["exists","up"]},{"osd":2,"uuid":"01e8286e-30af-41c7-bcd1-c4545f9f0a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":26873},{"type":"v1","addr":"172.21.15.156:6809","nonce":26873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":26873},{"type":"v1","addr":"172.21.15.156:6811","nonce":26873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":26873},{"type":"v1","addr":"172.21.15.156:6817","nonce":26873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":26873},{"type":"v1","addr":"172.21.15.156:6813","nonce":26873}]},"public_addr":"172.21.15.156:6809/26873","cluster_addr":"172.21.15.156:6811/26873","heartbeat_back_addr":"172.21.15.156:6817/26873","heartbeat_front_addr":"172.21.15.156:6813/26873","state":["exists","up"]},{"osd":3,"uuid":"4f6a1234-5ac6-43b0-baaa-3567ab7c73a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6815","nonce":26875},{"type":"v1","addr":"172.21.15.156:6816","nonce":26875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":26875},{"type":"v1","addr":"172.21.15.156:6819","nonce":26875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":26875},{"type":"v1","addr":"172.21.15.156:6823","nonce":26875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":26875},{"type":"v1","addr":"172.21.15.156:6821","nonce":26875}]},"public_addr":"172.21.15.156:6816/26875","cluster_addr":"172.21.15.156:6819/26875","heartbeat_back_addr":"172.21.15.156:6823/26875","heartbeat_front_addr":"172.21.15.156:6821/26875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.582513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.686413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:05:12.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc665d1700 10 mgrc shutdown 2023-09-29T23:05:12.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc665d1700 1 -- 172.21.15.115:0/3531967031 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fcc4408e8b0 msgr2=0x7fcc44090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc665d1700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fcc4408e8b0 0x7fcc44090d60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcc600a6130 tx=0x7fcc5c019000 comp rx=0 tx=0).stop 2023-09-29T23:05:12.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc665d1700 1 -- 172.21.15.115:0/3531967031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc60067b60 msgr2=0x7fcc60152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc665d1700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc60067b60 0x7fcc60152b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400ec80 tx=0x7fcc540091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc665d1700 1 -- 172.21.15.115:0/3531967031 shutdown_connections 2023-09-29T23:05:12.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc665d1700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc600a4370 0x7fcc60134560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc665d1700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc6006eda0 0x7fcc600b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc665d1700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fcc4408e8b0 0x7fcc44090d60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc665d1700 1 --2- 172.21.15.115:0/3531967031 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc60067b60 0x7fcc60152b60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc665d1700 1 -- 172.21.15.115:0/3531967031 >> 172.21.15.115:0/3531967031 conn(0x7fcc60068a40 msgr2=0x7fcc60062b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:12.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc665d1700 1 -- 172.21.15.115:0/3531967031 shutdown_connections 2023-09-29T23:05:12.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.813+0000 7fcc665d1700 1 -- 172.21.15.115:0/3531967031 wait complete. 2023-09-29T23:05:12.829 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-29T23:05:12.830 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-29T23:05:12.830 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-29T23:05:12.830 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-29T23:05:12.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.921+0000 7f4dc2e2a700 1 Processor -- start 2023-09-29T23:05:12.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2e2a700 1 -- start start 2023-09-29T23:05:12.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2e2a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4dbc06f920 0x7f4dbc13b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2e2a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc06d5b0 con 0x7f4dbc069f20 2023-09-29T23:05:12.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2e2a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc06fdf0 con 0x7f4dbc06d1e0 2023-09-29T23:05:12.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2e2a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc06ee20 con 0x7f4dbc06f920 2023-09-29T23:05:12.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2629700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4dbc06f920 0x7f4dbc13b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.927 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2629700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4dbc06f920 0x7f4dbc13b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40866/0 (socket says 172.21.15.115:40866) 2023-09-29T23:05:12.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc1627700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4dbc069f20 0x7f4dbc06f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41694/0 (socket says 172.21.15.115:41694) 2023-09-29T23:05:12.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2629700 1 -- 172.21.15.115:0/3980715743 learned_addr learned my addr 172.21.15.115:0/3980715743 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:12.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2629700 1 -- 172.21.15.115:0/3980715743 >> v1:172.21.15.156:6789/0 conn(0x7f4dbc06d1e0 legacy=0x7f4dbc06e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:12.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2629700 1 -- 172.21.15.115:0/3980715743 >> v1:172.21.15.115:6789/0 conn(0x7f4dbc069f20 legacy=0x7f4dbc06f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2629700 1 -- 172.21.15.115:0/3980715743 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc13b9f0 con 0x7f4dbc06f920 2023-09-29T23:05:12.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc0e26700 1 -- 172.21.15.115:0/3980715743 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838052599 0 0) 0x7f4dbc06d5b0 con 0x7f4dbc069f20 2023-09-29T23:05:12.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2629700 1 --2- 172.21.15.115:0/3980715743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc06f920 0x7f4dbc13b4b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4db400d1a0 tx=0x7f4db400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f843b0bce7059e6d server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc0e26700 1 -- 172.21.15.115:0/3980715743 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4010070 con 0x7f4dbc06f920 2023-09-29T23:05:12.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc0e26700 1 -- 172.21.15.115:0/3980715743 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db400de80 con 0x7f4dbc06f920 2023-09-29T23:05:12.928 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc0e26700 1 -- 172.21.15.115:0/3980715743 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db400b320 con 0x7f4dbc06f920 2023-09-29T23:05:12.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3980715743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc06f920 msgr2=0x7f4dbc13b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2e2a700 1 --2- 172.21.15.115:0/3980715743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc06f920 0x7f4dbc13b4b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4db400d1a0 tx=0x7f4db400ba50 comp rx=0 tx=0).stop 2023-09-29T23:05:12.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3980715743 shutdown_connections 2023-09-29T23:05:12.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2e2a700 1 --2- 172.21.15.115:0/3980715743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc06f920 0x7f4dbc13b4b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3980715743 >> 172.21.15.115:0/3980715743 conn(0x7f4dbc0a2a60 msgr2=0x7f4dbc0a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:12.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3980715743 shutdown_connections 2023-09-29T23:05:12.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3980715743 wait complete. 2023-09-29T23:05:12.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7fdbea55e700 1 Processor -- start 2023-09-29T23:05:12.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.925+0000 7fdbea55e700 1 -- start start 2023-09-29T23:05:12.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2e2a700 1 Processor -- start 2023-09-29T23:05:12.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2e2a700 1 -- start start 2023-09-29T23:05:12.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2e2a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dbc069f20 0x7f4dbc13efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2e2a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dbc06d1e0 0x7f4dbc13db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2e2a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc06f920 0x7f4dbc145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2e2a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc13e510 con 0x7f4dbc06f920 2023-09-29T23:05:12.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2e2a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc13e7d0 con 0x7f4dbc06d1e0 2023-09-29T23:05:12.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2e2a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc13ea90 con 0x7f4dbc069f20 2023-09-29T23:05:12.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbea55e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdbe4143990 0x7fdbe414b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbea55e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe40686b0 con 0x7fdbe4143590 2023-09-29T23:05:12.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbea55e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe4143db0 con 0x7fdbe40682e0 2023-09-29T23:05:12.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbea55e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe4143040 con 0x7fdbe4143990 2023-09-29T23:05:12.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2629700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc06f920 0x7f4dbc145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2629700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc06f920 0x7f4dbc145560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40872/0 (socket says 172.21.15.115:40872) 2023-09-29T23:05:12.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2629700 1 -- 172.21.15.115:0/3548877652 learned_addr learned my addr 172.21.15.115:0/3548877652 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:12.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc1e28700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dbc069f20 0x7f4dbc13efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbe8d5b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdbe4143590 0x7fdbe40b16a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41708/0 (socket says 172.21.15.115:41708) 2023-09-29T23:05:12.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbe8d5b700 1 -- 172.21.15.115:0/2703655148 learned_addr learned my addr 172.21.15.115:0/2703655148 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:12.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc1627700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dbc06d1e0 0x7f4dbc13db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2629700 1 -- 172.21.15.115:0/3548877652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dbc069f20 msgr2=0x7f4dbc13efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2629700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4dbc069f20 0x7f4dbc13efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2629700 1 -- 172.21.15.115:0/3548877652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dbc06d1e0 msgr2=0x7f4dbc13db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2629700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dbc06d1e0 0x7f4dbc13db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2629700 1 -- 172.21.15.115:0/3548877652 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db400bcf0 con 0x7f4dbc06f920 2023-09-29T23:05:12.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbe9d5d700 1 --2- 172.21.15.115:0/2703655148 >> v2:172.21.15.115:3300/0 conn(0x7fdbe4143990 0x7fdbe414b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbdbfff700 1 -- 172.21.15.115:0/2703655148 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111853960 0 0) 0x7fdbe4143db0 con 0x7fdbe40682e0 2023-09-29T23:05:12.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbdbfff700 1 -- 172.21.15.115:0/2703655148 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd0003570 con 0x7fdbe40682e0 2023-09-29T23:05:12.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2629700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc06f920 0x7f4dbc145560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc06b5d0 tx=0x7f4db4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbdbfff700 1 -- 172.21.15.115:0/2703655148 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557009600 0 0) 0x7fdbe40686b0 con 0x7fdbe4143590 2023-09-29T23:05:12.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbdbfff700 1 -- 172.21.15.115:0/2703655148 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe4143db0 con 0x7fdbe4143590 2023-09-29T23:05:12.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbe9d5d700 1 -- 172.21.15.115:0/2703655148 >> v1:172.21.15.156:6789/0 conn(0x7fdbe40682e0 legacy=0x7fdbe409aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbe9d5d700 1 -- 172.21.15.115:0/2703655148 >> v1:172.21.15.115:6789/0 conn(0x7fdbe4143590 legacy=0x7fdbe40b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbe9d5d700 1 -- 172.21.15.115:0/2703655148 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe4143300 con 0x7fdbe4143990 2023-09-29T23:05:12.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbe9d5d700 1 --2- 172.21.15.115:0/2703655148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbe4143990 0x7fdbe414b270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009e60 tx=0x7fdbdc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103d5ca918279629 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbdbfff700 1 -- 172.21.15.115:0/2703655148 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc00e070 con 0x7fdbe4143990 2023-09-29T23:05:12.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbdbfff700 1 -- 172.21.15.115:0/2703655148 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc00bb40 con 0x7fdbe4143990 2023-09-29T23:05:12.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbdbfff700 1 -- 172.21.15.115:0/2703655148 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc012430 con 0x7fdbe4143990 2023-09-29T23:05:12.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4db1ffb700 1 -- 172.21.15.115:0/3548877652 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4009b80 con 0x7f4dbc06f920 2023-09-29T23:05:12.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4db1ffb700 1 -- 172.21.15.115:0/3548877652 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4009ce0 con 0x7f4dbc06f920 2023-09-29T23:05:12.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3548877652 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc13fb10 con 0x7f4dbc06f920 2023-09-29T23:05:12.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbea55e700 1 -- 172.21.15.115:0/2703655148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbe4143990 msgr2=0x7fdbe414b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbea55e700 1 --2- 172.21.15.115:0/2703655148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbe4143990 0x7fdbe414b270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009e60 tx=0x7fdbdc009780 comp rx=0 tx=0).stop 2023-09-29T23:05:12.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4db1ffb700 1 -- 172.21.15.115:0/3548877652 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4014680 con 0x7f4dbc06f920 2023-09-29T23:05:12.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3548877652 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc13f4f0 con 0x7f4dbc06f920 2023-09-29T23:05:12.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbea55e700 1 -- 172.21.15.115:0/2703655148 shutdown_connections 2023-09-29T23:05:12.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbea55e700 1 --2- 172.21.15.115:0/2703655148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbe4143990 0x7fdbe414b270 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbea55e700 1 -- 172.21.15.115:0/2703655148 >> 172.21.15.115:0/2703655148 conn(0x7fdbe40692c0 msgr2=0x7fdbe40696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:12.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.929+0000 7fdbea55e700 1 -- 172.21.15.115:0/2703655148 shutdown_connections 2023-09-29T23:05:12.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbea55e700 1 -- 172.21.15.115:0/2703655148 wait complete. 2023-09-29T23:05:12.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3548877652 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4dbc04be00 con 0x7f4dbc06f920 2023-09-29T23:05:12.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbea55e700 1 Processor -- start 2023-09-29T23:05:12.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbea55e700 1 -- start start 2023-09-29T23:05:12.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbea55e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe40682e0 0x7fdbe413dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbea55e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbe4143590 0x7fdbe409fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbea55e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbe4143990 0x7fdbe409c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbea55e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe409d650 con 0x7fdbe4143990 2023-09-29T23:05:12.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbea55e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe409d850 con 0x7fdbe40682e0 2023-09-29T23:05:12.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbea55e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40a0470 con 0x7fdbe4143590 2023-09-29T23:05:12.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbe8d5b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbe4143590 0x7fdbe409fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbe9d5d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbe4143990 0x7fdbe409c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbe8d5b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbe4143590 0x7fdbe409fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33198/0 (socket says 172.21.15.115:33198) 2023-09-29T23:05:12.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbe9d5d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbe4143990 0x7fdbe409c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40884/0 (socket says 172.21.15.115:40884) 2023-09-29T23:05:12.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbe8d5b700 1 -- 172.21.15.115:0/2547729413 learned_addr learned my addr 172.21.15.115:0/2547729413 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:12.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbe955c700 1 --2- 172.21.15.115:0/2547729413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe40682e0 0x7fdbe413dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbe8d5b700 1 -- 172.21.15.115:0/2547729413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe40682e0 msgr2=0x7fdbe413dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbe8d5b700 1 --2- 172.21.15.115:0/2547729413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe40682e0 0x7fdbe413dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbe8d5b700 1 -- 172.21.15.115:0/2547729413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbe4143990 msgr2=0x7fdbe409c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbe8d5b700 1 --2- 172.21.15.115:0/2547729413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbe4143990 0x7fdbe409c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbe8d5b700 1 -- 172.21.15.115:0/2547729413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc009a20 con 0x7fdbe4143590 2023-09-29T23:05:12.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbe8d5b700 1 --2- 172.21.15.115:0/2547729413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbe4143590 0x7fdbe409fae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000c7c0 tx=0x7fdbe0007e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7f4db1ffb700 1 -- 172.21.15.115:0/3548877652 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f4db401b050 con 0x7f4dbc06f920 2023-09-29T23:05:12.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7f4db1ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:12.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbd97fa700 1 -- 172.21.15.115:0/2547729413 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0005b30 con 0x7fdbe4143590 2023-09-29T23:05:12.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbd97fa700 1 -- 172.21.15.115:0/2547729413 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe0005c90 con 0x7fdbe4143590 2023-09-29T23:05:12.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbea55e700 1 -- 172.21.15.115:0/2547729413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe40a0730 con 0x7fdbe4143590 2023-09-29T23:05:12.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbd97fa700 1 -- 172.21.15.115:0/2547729413 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0007320 con 0x7fdbe4143590 2023-09-29T23:05:12.945 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.933+0000 7fdbea55e700 1 -- 172.21.15.115:0/2547729413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe413cab0 con 0x7fdbe4143590 2023-09-29T23:05:12.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7f4db1ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:12.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7f4db1ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:12.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7f4db1ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:12.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7f4db1ffb700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4da008e980 0x7f4da0090e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7f4db1ffb700 1 -- 172.21.15.115:0/3548877652 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f4db40b5f70 con 0x7f4dbc06f920 2023-09-29T23:05:12.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbea55e700 1 -- 172.21.15.115:0/2547729413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdbe404be00 con 0x7fdbe4143590 2023-09-29T23:05:12.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7f4db1ffb700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.156:6800/26874,v1:172.21.15.156:6801/26874] conn(0x7f4da00964e0 0x7f4da0098910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7f4dc1e28700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4da008e980 0x7f4da0090e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7f4db1ffb700 1 -- 172.21.15.115:0/3548877652 --> [v2:172.21.15.156:6800/26874,v1:172.21.15.156:6801/26874] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4da0098fe0 con 0x7f4da00964e0 2023-09-29T23:05:12.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7f4db1ffb700 1 -- 172.21.15.115:0/3548877652 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4db40b6340 con 0x7f4dbc06f920 2023-09-29T23:05:12.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7f4dc1627700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.156:6800/26874,v1:172.21.15.156:6801/26874] conn(0x7f4da00964e0 0x7f4da0098910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbd97fa700 1 -- 172.21.15.115:0/2547729413 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fdbe001b3b0 con 0x7fdbe4143590 2023-09-29T23:05:12.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbd97fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:12.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7f4dc1e28700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4da008e980 0x7f4da0090e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4db8003a30 tx=0x7f4db8007ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7f4dc1627700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.156:6800/26874,v1:172.21.15.156:6801/26874] conn(0x7f4da00964e0 0x7f4da0098910 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbd97fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:12.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbd97fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:12.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbd97fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:12.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbd97fa700 1 --2- 172.21.15.115:0/2547729413 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fdbc808e8e0 0x7fdbc8090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbd97fa700 1 -- 172.21.15.115:0/2547729413 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fdbe00b3cc0 con 0x7fdbe4143590 2023-09-29T23:05:12.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbe955c700 1 --2- 172.21.15.115:0/2547729413 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fdbc808e8e0 0x7fdbc8090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbd97fa700 1 --2- 172.21.15.115:0/2547729413 >> [v2:172.21.15.115:6800/26662,v1:172.21.15.115:6801/26662] conn(0x7fdbc8096430 0x7fdbc8098860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbd97fa700 1 -- 172.21.15.115:0/2547729413 --> [v2:172.21.15.115:6800/26662,v1:172.21.15.115:6801/26662] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbc8098f30 con 0x7fdbc8096430 2023-09-29T23:05:12.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbd97fa700 1 -- 172.21.15.115:0/2547729413 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbe00b8030 con 0x7fdbe4143590 2023-09-29T23:05:12.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbe9d5d700 1 --2- 172.21.15.115:0/2547729413 >> [v2:172.21.15.115:6800/26662,v1:172.21.15.115:6801/26662] conn(0x7fdbc8096430 0x7fdbc8098860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbe9d5d700 1 --2- 172.21.15.115:0/2547729413 >> [v2:172.21.15.115:6800/26662,v1:172.21.15.115:6801/26662] conn(0x7fdbc8096430 0x7fdbc8098860 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7fdbe955c700 1 --2- 172.21.15.115:0/2547729413 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fdbc808e8e0 0x7fdbc8090d90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4007fd0 tx=0x7fdbd4007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.937+0000 7f698359e700 1 Processor -- start 2023-09-29T23:05:12.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f4db1ffb700 1 -- 172.21.15.115:0/3548877652 <== osd.1 v2:172.21.15.156:6800/26874 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f4da0098fe0 con 0x7f4da00964e0 2023-09-29T23:05:12.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 -- start start 2023-09-29T23:05:12.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69840afc90 0x7f69840b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f698409eb30 0x7f698413d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f69840b0060 0x7f698413c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698413ce70 con 0x7f69840b0060 2023-09-29T23:05:12.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69840b1ca0 con 0x7f698409eb30 2023-09-29T23:05:12.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69840b1f60 con 0x7f69840afc90 2023-09-29T23:05:12.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7fdbd97fa700 1 -- 172.21.15.115:0/2547729413 <== osd.0 v2:172.21.15.115:6800/26662 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fdbc8098f30 con 0x7fdbc8096430 2023-09-29T23:05:12.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698259c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69840afc90 0x7f69840b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f6982d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f69840b0060 0x7f698413c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f6981d9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f698409eb30 0x7f698413d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f6982d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f69840b0060 0x7f698413c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40898/0 (socket says 172.21.15.115:40898) 2023-09-29T23:05:12.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f6982d9d700 1 -- 172.21.15.115:0/631564156 learned_addr learned my addr 172.21.15.115:0/631564156 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:12.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698259c700 1 -- 172.21.15.115:0/631564156 >> v2:172.21.15.156:3300/0 conn(0x7f698409eb30 msgr2=0x7f698413d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:12.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698259c700 1 --2- 172.21.15.115:0/631564156 >> v2:172.21.15.156:3300/0 conn(0x7f698409eb30 0x7f698413d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698259c700 1 -- 172.21.15.115:0/631564156 >> v2:172.21.15.115:3300/0 conn(0x7f69840b0060 msgr2=0x7f698413c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:12.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698259c700 1 --2- 172.21.15.115:0/631564156 >> v2:172.21.15.115:3300/0 conn(0x7f69840b0060 0x7f698413c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698259c700 1 -- 172.21.15.115:0/631564156 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698413cc20 con 0x7f69840afc90 2023-09-29T23:05:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f6982d9d700 1 --2- 172.21.15.115:0/631564156 >> v2:172.21.15.115:3300/0 conn(0x7f69840b0060 0x7f698413c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698259c700 1 --2- 172.21.15.115:0/631564156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69840afc90 0x7f69840b1630 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f69840b04f0 tx=0x7f697800b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d926efa1b1fbae7 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698159a700 1 -- 172.21.15.115:0/631564156 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697800da70 con 0x7f69840afc90 2023-09-29T23:05:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698159a700 1 -- 172.21.15.115:0/631564156 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697800dbd0 con 0x7f69840afc90 2023-09-29T23:05:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698159a700 1 -- 172.21.15.115:0/631564156 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978019480 con 0x7f69840afc90 2023-09-29T23:05:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 -- 172.21.15.115:0/631564156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69840afc90 msgr2=0x7f69840b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 --2- 172.21.15.115:0/631564156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69840afc90 0x7f69840b1630 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f69840b04f0 tx=0x7f697800b430 comp rx=0 tx=0).stop 2023-09-29T23:05:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 -- 172.21.15.115:0/631564156 shutdown_connections 2023-09-29T23:05:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 --2- 172.21.15.115:0/631564156 >> v2:172.21.15.115:3300/0 conn(0x7f69840b0060 0x7f698413c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 --2- 172.21.15.115:0/631564156 >> v2:172.21.15.156:3300/0 conn(0x7f698409eb30 0x7f698413d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 --2- 172.21.15.115:0/631564156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69840afc90 0x7f69840b1630 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 -- 172.21.15.115:0/631564156 >> 172.21.15.115:0/631564156 conn(0x7f6984069d90 msgr2=0x7f69840670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:12.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 -- 172.21.15.115:0/631564156 shutdown_connections 2023-09-29T23:05:12.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.941+0000 7f698359e700 1 -- 172.21.15.115:0/631564156 wait complete. 2023-09-29T23:05:12.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f698359e700 1 Processor -- start 2023-09-29T23:05:12.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f698359e700 1 -- start start 2023-09-29T23:05:12.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd06d3f2700 1 Processor -- start 2023-09-29T23:05:12.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd06d3f2700 1 -- start start 2023-09-29T23:05:12.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f698359e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f698409eb30 0x7f69841402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f698359e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69840afc90 0x7f6984095520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f698359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69840b0060 0x7f69841415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f698359e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6984095a60 con 0x7f698409eb30 2023-09-29T23:05:12.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f698359e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6984141150 con 0x7f69840afc90 2023-09-29T23:05:12.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f698359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698413eef0 con 0x7f69840b0060 2023-09-29T23:05:12.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f698259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f698409eb30 0x7f69841402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f6982d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69840b0060 0x7f69841415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f6982d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69840b0060 0x7f69841415e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33216/0 (socket says 172.21.15.115:33216) 2023-09-29T23:05:12.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f6982d9d700 1 -- 172.21.15.115:0/1628533573 learned_addr learned my addr 172.21.15.115:0/1628533573 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:12.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f6981d9b700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69840afc90 0x7f6984095520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd06d3f2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd068068250 0x7fd0680b2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd06d3f2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd0680a1680 0x7fd06809d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd06d3f2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0680b2790 con 0x7fd0680a1a70 2023-09-29T23:05:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd06d3f2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0680b2bd0 con 0x7fd0680a1680 2023-09-29T23:05:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd06d3f2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06809c8f0 con 0x7fd068068250 2023-09-29T23:05:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f6982d9d700 1 -- 172.21.15.115:0/1628533573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69840afc90 msgr2=0x7f6984095520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f6982d9d700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69840afc90 0x7f6984095520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f6982d9d700 1 -- 172.21.15.115:0/1628533573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f698409eb30 msgr2=0x7f69841402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f6982d9d700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f698409eb30 0x7f69841402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f6982d9d700 1 -- 172.21.15.115:0/1628533573 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c009ae0 con 0x7f69840b0060 2023-09-29T23:05:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f698259c700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f698409eb30 0x7f69841402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd0677fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd0680a1680 0x7fd06809d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd0677fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd0680a1680 0x7fd06809d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40914/0 (socket says 172.21.15.115:40914) 2023-09-29T23:05:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd0677fe700 1 -- 172.21.15.115:0/1466078161 learned_addr learned my addr 172.21.15.115:0/1466078161 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:12.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f6982d9d700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69840b0060 0x7f69841415e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f697c00ef90 tx=0x7f697c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd067fff700 1 --2- 172.21.15.115:0/1466078161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd068068250 0x7fd0680b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd0677fe700 1 -- 172.21.15.115:0/1466078161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd068068250 msgr2=0x7fd0680b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:12.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f69727fc700 1 -- 172.21.15.115:0/1628533573 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c00c960 con 0x7f69840b0060 2023-09-29T23:05:12.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd0677fe700 1 --2- 172.21.15.115:0/1466078161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd068068250 0x7fd0680b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd0677fe700 1 -- 172.21.15.115:0/1466078161 >> v1:172.21.15.156:6789/0 conn(0x7fd0680a1a70 legacy=0x7fd0680b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd0677fe700 1 -- 172.21.15.115:0/1466078161 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06809ecb0 con 0x7fd0680a1680 2023-09-29T23:05:12.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd067fff700 1 --2- 172.21.15.115:0/1466078161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd068068250 0x7fd0680b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f69727fc700 1 -- 172.21.15.115:0/1628533573 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c00f040 con 0x7f69840b0060 2023-09-29T23:05:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f698359e700 1 -- 172.21.15.115:0/1628533573 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697800b6d0 con 0x7f69840b0060 2023-09-29T23:05:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f69727fc700 1 -- 172.21.15.115:0/1628533573 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c00ccf0 con 0x7f69840b0060 2023-09-29T23:05:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f698359e700 1 -- 172.21.15.115:0/1628533573 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698413ecc0 con 0x7f69840b0060 2023-09-29T23:05:12.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7f698359e700 1 -- 172.21.15.115:0/1628533573 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f698404be00 con 0x7f69840b0060 2023-09-29T23:05:12.965 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.945+0000 7fd0677fe700 1 --2- 172.21.15.115:0/1466078161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0680a1680 0x7fd06809d060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00bc50 tx=0x7fd05c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1b25916213b8b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd066ffd700 1 -- 172.21.15.115:0/1466078161 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00dbf0 con 0x7fd0680a1680 2023-09-29T23:05:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd066ffd700 1 -- 172.21.15.115:0/1466078161 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c00dd50 con 0x7fd0680a1680 2023-09-29T23:05:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd066ffd700 1 -- 172.21.15.115:0/1466078161 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0196b0 con 0x7fd0680a1680 2023-09-29T23:05:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 -- 172.21.15.115:0/1466078161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0680a1680 msgr2=0x7fd06809d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 --2- 172.21.15.115:0/1466078161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0680a1680 0x7fd06809d060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00bc50 tx=0x7fd05c00b4f0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 -- 172.21.15.115:0/1466078161 shutdown_connections 2023-09-29T23:05:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 --2- 172.21.15.115:0/1466078161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0680a1680 0x7fd06809d060 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 --2- 172.21.15.115:0/1466078161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd068068250 0x7fd0680b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 -- 172.21.15.115:0/1466078161 >> 172.21.15.115:0/1466078161 conn(0x7fd0680692c0 msgr2=0x7fd0680696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 -- 172.21.15.115:0/1466078161 shutdown_connections 2023-09-29T23:05:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 -- 172.21.15.115:0/1466078161 wait complete. 2023-09-29T23:05:12.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7f69727fc700 1 -- 172.21.15.115:0/1628533573 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f697c0137d0 con 0x7f69840b0060 2023-09-29T23:05:12.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7f69727fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:12.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 Processor -- start 2023-09-29T23:05:12.968 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 -- start start 2023-09-29T23:05:12.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7f69727fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:12.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7f69727fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:12.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7f69727fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:12.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7f69727fc700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f696408e8e0 0x7f6964090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd068068250 0x7fd06809fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0680a1680 0x7fd06813ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0680a1a70 0x7fd06813b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06806f460 con 0x7fd0680a1680 2023-09-29T23:05:12.970 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06806e1d0 con 0x7fd0680a1a70 2023-09-29T23:05:12.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06d3f2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06806e470 con 0x7fd068068250 2023-09-29T23:05:12.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7f69727fc700 1 -- 172.21.15.115:0/1628533573 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f697c0b9030 con 0x7f69840b0060 2023-09-29T23:05:12.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd0677fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0680a1680 0x7fd06813ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.971 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd067fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd068068250 0x7fd06809fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd0677fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0680a1680 0x7fd06813ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40916/0 (socket says 172.21.15.115:40916) 2023-09-29T23:05:12.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd0677fe700 1 -- 172.21.15.115:0/4115157519 learned_addr learned my addr 172.21.15.115:0/4115157519 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:12.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7f698259c700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f696408e8e0 0x7f6964090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7f69727fc700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.156:6815/26875,v1:172.21.15.156:6816/26875] conn(0x7f6964096440 0x7f6964098870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7f69727fc700 1 -- 172.21.15.115:0/1628533573 --> [v2:172.21.15.156:6815/26875,v1:172.21.15.156:6816/26875] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6964098f40 con 0x7f6964096440 2023-09-29T23:05:12.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7f69727fc700 1 -- 172.21.15.115:0/1628533573 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f697c0b9400 con 0x7f69840b0060 2023-09-29T23:05:12.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd06cbf1700 1 --2- 172.21.15.115:0/4115157519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0680a1a70 0x7fd06813b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd0677fe700 1 -- 172.21.15.115:0/4115157519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd068068250 msgr2=0x7fd06809fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd0677fe700 1 --2- 172.21.15.115:0/4115157519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd068068250 0x7fd06809fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd0677fe700 1 -- 172.21.15.115:0/4115157519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0680a1a70 msgr2=0x7fd06813b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd0677fe700 1 --2- 172.21.15.115:0/4115157519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0680a1a70 0x7fd06813b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd0677fe700 1 -- 172.21.15.115:0/4115157519 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd060009a20 con 0x7fd0680a1680 2023-09-29T23:05:12.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7f6981d9b700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.156:6815/26875,v1:172.21.15.156:6816/26875] conn(0x7f6964096440 0x7f6964098870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd0677fe700 1 --2- 172.21.15.115:0/4115157519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0680a1680 0x7fd06813ad20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00b760 tx=0x7fd05c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd04ffff700 1 -- 172.21.15.115:0/4115157519 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c010470 con 0x7fd0680a1680 2023-09-29T23:05:12.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.949+0000 7fd04ffff700 1 -- 172.21.15.115:0/4115157519 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c0105d0 con 0x7fd0680a1680 2023-09-29T23:05:12.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd06d3f2700 1 -- 172.21.15.115:0/4115157519 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05c00b790 con 0x7fd0680a1680 2023-09-29T23:05:12.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd04ffff700 1 -- 172.21.15.115:0/4115157519 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c010970 con 0x7fd0680a1680 2023-09-29T23:05:12.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7f698259c700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f696408e8e0 0x7f6964090d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f697800b2c0 tx=0x7f697801b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd06d3f2700 1 -- 172.21.15.115:0/4115157519 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0680a0220 con 0x7fd0680a1680 2023-09-29T23:05:12.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7f6981d9b700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.156:6815/26875,v1:172.21.15.156:6816/26875] conn(0x7f6964096440 0x7f6964098870 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd06d3f2700 1 -- 172.21.15.115:0/4115157519 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd06804be00 con 0x7fd0680a1680 2023-09-29T23:05:12.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7f69727fc700 1 -- 172.21.15.115:0/1628533573 <== osd.3 v2:172.21.15.156:6815/26875 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f6964098f40 con 0x7f6964096440 2023-09-29T23:05:12.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd04ffff700 1 -- 172.21.15.115:0/4115157519 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fd05c022070 con 0x7fd0680a1680 2023-09-29T23:05:12.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd04ffff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:12.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd04ffff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:12.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd04ffff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:12.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd04ffff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:12.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd04ffff700 1 --2- 172.21.15.115:0/4115157519 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd05408e8b0 0x7fd054090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd04ffff700 1 -- 172.21.15.115:0/4115157519 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fd05c014070 con 0x7fd0680a1680 2023-09-29T23:05:12.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd04ffff700 1 --2- 172.21.15.115:0/4115157519 >> [v2:172.21.15.156:6808/26873,v1:172.21.15.156:6809/26873] conn(0x7fd054096410 0x7fd054098840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:12.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd04ffff700 1 -- 172.21.15.115:0/4115157519 --> [v2:172.21.15.156:6808/26873,v1:172.21.15.156:6809/26873] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd054098f10 con 0x7fd054096410 2023-09-29T23:05:12.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd04ffff700 1 -- 172.21.15.115:0/4115157519 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd05c0ba630 con 0x7fd0680a1680 2023-09-29T23:05:12.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.953+0000 7fd06cbf1700 1 --2- 172.21.15.115:0/4115157519 >> [v2:172.21.15.156:6808/26873,v1:172.21.15.156:6809/26873] conn(0x7fd054096410 0x7fd054098840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fd06cbf1700 1 --2- 172.21.15.115:0/4115157519 >> [v2:172.21.15.156:6808/26873,v1:172.21.15.156:6809/26873] conn(0x7fd054096410 0x7fd054098840 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbea55e700 1 -- 172.21.15.115:0/2547729413 --> [v2:172.21.15.115:6800/26662,v1:172.21.15.115:6801/26662] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdbe409b1e0 con 0x7fdbc8096430 2023-09-29T23:05:12.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3548877652 --> [v2:172.21.15.156:6800/26874,v1:172.21.15.156:6801/26874] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4dbc13e2c0 con 0x7f4da00964e0 2023-09-29T23:05:12.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbd97fa700 1 -- 172.21.15.115:0/2547729413 <== osd.0 v2:172.21.15.115:6800/26662 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdbe409b1e0 con 0x7fdbc8096430 2023-09-29T23:05:12.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4db1ffb700 1 -- 172.21.15.115:0/3548877652 <== osd.1 v2:172.21.15.156:6800/26874 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4dbc13e2c0 con 0x7f4da00964e0 2023-09-29T23:05:12.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbea55e700 1 -- 172.21.15.115:0/2547729413 >> [v2:172.21.15.115:6800/26662,v1:172.21.15.115:6801/26662] conn(0x7fdbc8096430 msgr2=0x7fdbc8098860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbea55e700 1 --2- 172.21.15.115:0/2547729413 >> [v2:172.21.15.115:6800/26662,v1:172.21.15.115:6801/26662] conn(0x7fdbc8096430 0x7fdbc8098860 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbea55e700 10 mgrc shutdown 2023-09-29T23:05:12.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbea55e700 1 -- 172.21.15.115:0/2547729413 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fdbc808e8e0 msgr2=0x7fdbc8090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbea55e700 1 --2- 172.21.15.115:0/2547729413 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fdbc808e8e0 0x7fdbc8090d90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4007fd0 tx=0x7fdbd4007d50 comp rx=0 tx=0).stop 2023-09-29T23:05:12.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbea55e700 1 -- 172.21.15.115:0/2547729413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbe4143590 msgr2=0x7fdbe409fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbea55e700 1 --2- 172.21.15.115:0/2547729413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbe4143590 0x7fdbe409fae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000c7c0 tx=0x7fdbe0007e80 comp rx=0 tx=0).stop 2023-09-29T23:05:12.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbe9d5d700 1 -- 172.21.15.115:0/2547729413 reap_dead start 2023-09-29T23:05:12.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3548877652 >> [v2:172.21.15.156:6800/26874,v1:172.21.15.156:6801/26874] conn(0x7f4da00964e0 msgr2=0x7f4da0098910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4dc2e2a700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.156:6800/26874,v1:172.21.15.156:6801/26874] conn(0x7f4da00964e0 0x7f4da0098910 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4dc2e2a700 10 mgrc shutdown 2023-09-29T23:05:12.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3548877652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4da008e980 msgr2=0x7f4da0090e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbea55e700 1 -- 172.21.15.115:0/2547729413 shutdown_connections 2023-09-29T23:05:12.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbea55e700 1 -- 172.21.15.115:0/2547729413 >> 172.21.15.115:0/2547729413 conn(0x7fdbe40692c0 msgr2=0x7fdbe413eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:12.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4dc2e2a700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4da008e980 0x7f4da0090e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4db8003a30 tx=0x7f4db8007ea0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3548877652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc06f920 msgr2=0x7f4dbc145560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4dc2e2a700 1 --2- 172.21.15.115:0/3548877652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dbc06f920 0x7f4dbc145560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc06b5d0 tx=0x7f4db4019000 comp rx=0 tx=0).stop 2023-09-29T23:05:12.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4dc2629700 1 -- 172.21.15.115:0/3548877652 reap_dead start 2023-09-29T23:05:12.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3548877652 shutdown_connections 2023-09-29T23:05:12.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3548877652 >> 172.21.15.115:0/3548877652 conn(0x7f4dbc0a2a60 msgr2=0x7f4dbc062b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:12.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3548877652 shutdown_connections 2023-09-29T23:05:12.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fd04ffff700 1 -- 172.21.15.115:0/4115157519 <== osd.2 v2:172.21.15.156:6808/26873 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fd054098f10 con 0x7fd054096410 2023-09-29T23:05:12.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7f4dc2e2a700 1 -- 172.21.15.115:0/3548877652 wait complete. 2023-09-29T23:05:12.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbea55e700 1 -- 172.21.15.115:0/2547729413 shutdown_connections 2023-09-29T23:05:12.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.957+0000 7fdbea55e700 1 -- 172.21.15.115:0/2547729413 wait complete. 2023-09-29T23:05:12.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.965+0000 7f698359e700 1 -- 172.21.15.115:0/1628533573 --> [v2:172.21.15.156:6815/26875,v1:172.21.15.156:6816/26875] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f698409e610 con 0x7f6964096440 2023-09-29T23:05:12.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.969+0000 7f69727fc700 1 -- 172.21.15.115:0/1628533573 <== osd.3 v2:172.21.15.156:6815/26875 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f698409e610 con 0x7f6964096440 2023-09-29T23:05:12.985 INFO:teuthology.orchestra.run.smithi115.stdout:38654705669 2023-09-29T23:05:12.985 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-29T23:05:12.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.969+0000 7f698359e700 1 -- 172.21.15.115:0/1628533573 >> [v2:172.21.15.156:6815/26875,v1:172.21.15.156:6816/26875] conn(0x7f6964096440 msgr2=0x7f6964098870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.969+0000 7f698359e700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.156:6815/26875,v1:172.21.15.156:6816/26875] conn(0x7f6964096440 0x7f6964098870 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.969+0000 7f698359e700 10 mgrc shutdown 2023-09-29T23:05:12.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.969+0000 7f698359e700 1 -- 172.21.15.115:0/1628533573 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f696408e8e0 msgr2=0x7f6964090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.969+0000 7f698359e700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f696408e8e0 0x7f6964090d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f697800b2c0 tx=0x7f697801b000 comp rx=0 tx=0).stop 2023-09-29T23:05:12.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.969+0000 7f698359e700 1 -- 172.21.15.115:0/1628533573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69840b0060 msgr2=0x7f69841415e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.969+0000 7f698359e700 1 --2- 172.21.15.115:0/1628533573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69840b0060 0x7f69841415e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f697c00ef90 tx=0x7f697c00b040 comp rx=0 tx=0).stop 2023-09-29T23:05:12.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.969+0000 7f6982d9d700 1 -- 172.21.15.115:0/1628533573 reap_dead start 2023-09-29T23:05:12.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.969+0000 7f698359e700 1 -- 172.21.15.115:0/1628533573 shutdown_connections 2023-09-29T23:05:12.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.969+0000 7f698359e700 1 -- 172.21.15.115:0/1628533573 >> 172.21.15.115:0/1628533573 conn(0x7f6984069d90 msgr2=0x7f69840a2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:12.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.969+0000 7f698359e700 1 -- 172.21.15.115:0/1628533573 shutdown_connections 2023-09-29T23:05:12.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.969+0000 7f698359e700 1 -- 172.21.15.115:0/1628533573 wait complete. 2023-09-29T23:05:12.988 INFO:teuthology.orchestra.run.smithi115.stdout:38654705669 2023-09-29T23:05:12.988 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-29T23:05:12.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.973+0000 7fd067fff700 1 --2- 172.21.15.115:0/4115157519 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd05408e8b0 0x7fd054090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:12.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd06d3f2700 1 -- 172.21.15.115:0/4115157519 --> [v2:172.21.15.156:6808/26873,v1:172.21.15.156:6809/26873] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd0680b1df0 con 0x7fd054096410 2023-09-29T23:05:12.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd067fff700 1 --2- 172.21.15.115:0/4115157519 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd05408e8b0 0x7fd054090d60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd060009fd0 tx=0x7fd06000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:12.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd04ffff700 1 -- 172.21.15.115:0/4115157519 <== osd.2 v2:172.21.15.156:6808/26873 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd0680b1df0 con 0x7fd054096410 2023-09-29T23:05:12.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd06d3f2700 1 -- 172.21.15.115:0/4115157519 >> [v2:172.21.15.156:6808/26873,v1:172.21.15.156:6809/26873] conn(0x7fd054096410 msgr2=0x7fd054098840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd06d3f2700 1 --2- 172.21.15.115:0/4115157519 >> [v2:172.21.15.156:6808/26873,v1:172.21.15.156:6809/26873] conn(0x7fd054096410 0x7fd054098840 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:12.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd06d3f2700 10 mgrc shutdown 2023-09-29T23:05:12.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd06d3f2700 1 -- 172.21.15.115:0/4115157519 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd05408e8b0 msgr2=0x7fd054090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd06d3f2700 1 --2- 172.21.15.115:0/4115157519 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd05408e8b0 0x7fd054090d60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd060009fd0 tx=0x7fd06000b040 comp rx=0 tx=0).stop 2023-09-29T23:05:12.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd06d3f2700 1 -- 172.21.15.115:0/4115157519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0680a1680 msgr2=0x7fd06813ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:12.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd06d3f2700 1 --2- 172.21.15.115:0/4115157519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0680a1680 0x7fd06813ad20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00b760 tx=0x7fd05c01b000 comp rx=0 tx=0).stop 2023-09-29T23:05:12.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd06cbf1700 1 -- 172.21.15.115:0/4115157519 reap_dead start 2023-09-29T23:05:12.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd06d3f2700 1 -- 172.21.15.115:0/4115157519 shutdown_connections 2023-09-29T23:05:12.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd06d3f2700 1 -- 172.21.15.115:0/4115157519 >> 172.21.15.115:0/4115157519 conn(0x7fd0680692c0 msgr2=0x7fd06813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:12.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd06d3f2700 1 -- 172.21.15.115:0/4115157519 shutdown_connections 2023-09-29T23:05:12.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:12.977+0000 7fd06d3f2700 1 -- 172.21.15.115:0/4115157519 wait complete. 2023-09-29T23:05:12.994 INFO:teuthology.orchestra.run.smithi115.stdout:38654705669 2023-09-29T23:05:12.994 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-29T23:05:12.995 INFO:teuthology.orchestra.run.smithi115.stdout:38654705669 2023-09-29T23:05:12.995 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-29T23:05:13.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.085+0000 7f9c5e933700 1 Processor -- start 2023-09-29T23:05:13.089 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.085+0000 7f9c5e933700 1 -- start start 2023-09-29T23:05:13.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5e933700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9c58069f20 0x7f9c5806f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5e933700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5806d5b0 con 0x7f9c5806d1e0 2023-09-29T23:05:13.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5e933700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5806fb70 con 0x7f9c5806f750 2023-09-29T23:05:13.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5e933700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5806ee20 con 0x7f9c58069f20 2023-09-29T23:05:13.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5d931700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9c5806d1e0 0x7f9c5806e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41718/0 (socket says 172.21.15.115:41718) 2023-09-29T23:05:13.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5d931700 1 -- 172.21.15.115:0/3856308525 learned_addr learned my addr 172.21.15.115:0/3856308525 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:13.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5d130700 1 --2- 172.21.15.115:0/3856308525 >> v2:172.21.15.156:3300/0 conn(0x7f9c58069f20 0x7f9c5806f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577321966 0 0) 0x7f9c5806d5b0 con 0x7f9c5806d1e0 2023-09-29T23:05:13.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c44003570 con 0x7f9c5806d1e0 2023-09-29T23:05:13.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3567384370 0 0) 0x7f9c44003570 con 0x7f9c5806d1e0 2023-09-29T23:05:13.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 >> v2:172.21.15.156:3300/0 conn(0x7f9c58069f20 msgr2=0x7f9c5806f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:13.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 --2- 172.21.15.115:0/3856308525 >> v2:172.21.15.156:3300/0 conn(0x7f9c58069f20 0x7f9c5806f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 >> v1:172.21.15.156:6789/0 conn(0x7f9c5806f750 legacy=0x7f9c5813b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5806fdf0 con 0x7f9c5806d1e0 2023-09-29T23:05:13.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3987234196 0 0) 0x7f9c54001470 con 0x7f9c5806d1e0 2023-09-29T23:05:13.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 >> v1:172.21.15.115:6789/0 conn(0x7f9c5806d1e0 legacy=0x7f9c5806e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 --2- 172.21.15.115:0/3856308525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44003a60 0x7f9c44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 --2- 172.21.15.115:0/3856308525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c44004810 0x7f9c44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 --2- 172.21.15.115:0/3856308525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c440052e0 0x7f9c4400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4400c270 con 0x7f9c440052e0 2023-09-29T23:05:13.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4400c3e0 con 0x7f9c44004810 2023-09-29T23:05:13.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5e132700 1 --2- 172.21.15.115:0/3856308525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c440052e0 0x7f9c4400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5d931700 1 --2- 172.21.15.115:0/3856308525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44003a60 0x7f9c44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4400c5a0 con 0x7f9c44003a60 2023-09-29T23:05:13.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5d130700 1 --2- 172.21.15.115:0/3856308525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c44004810 0x7f9c44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5d931700 1 -- 172.21.15.115:0/3856308525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c44004810 msgr2=0x7f9c44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:13.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5d931700 1 --2- 172.21.15.115:0/3856308525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c44004810 0x7f9c44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5d931700 1 -- 172.21.15.115:0/3856308525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c440052e0 msgr2=0x7f9c4400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:13.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5d931700 1 --2- 172.21.15.115:0/3856308525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c440052e0 0x7f9c4400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5d931700 1 -- 172.21.15.115:0/3856308525 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44003570 con 0x7f9c44003a60 2023-09-29T23:05:13.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5e132700 1 --2- 172.21.15.115:0/3856308525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c440052e0 0x7f9c4400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:13.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5e132700 1 -- 172.21.15.115:0/3856308525 reap_dead start 2023-09-29T23:05:13.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5d931700 1 --2- 172.21.15.115:0/3856308525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44003a60 0x7f9c44003e70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400c3c0 tx=0x7f9c54001e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba2e90022529b464 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:13.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400cc90 con 0x7f9c44003a60 2023-09-29T23:05:13.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5400cdf0 con 0x7f9c44003a60 2023-09-29T23:05:13.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.089+0000 7f9c5c92f700 1 -- 172.21.15.115:0/3856308525 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54005b70 con 0x7f9c44003a60 2023-09-29T23:05:13.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 -- 172.21.15.115:0/3856308525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44003a60 msgr2=0x7f9c44003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 --2- 172.21.15.115:0/3856308525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44003a60 0x7f9c44003e70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400c3c0 tx=0x7f9c54001e50 comp rx=0 tx=0).stop 2023-09-29T23:05:13.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 -- 172.21.15.115:0/3856308525 shutdown_connections 2023-09-29T23:05:13.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 --2- 172.21.15.115:0/3856308525 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44003a60 0x7f9c44003e70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 -- 172.21.15.115:0/3856308525 >> 172.21.15.115:0/3856308525 conn(0x7f9c580a2a60 msgr2=0x7f9c580a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:13.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 -- 172.21.15.115:0/3856308525 shutdown_connections 2023-09-29T23:05:13.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 -- 172.21.15.115:0/3856308525 wait complete. 2023-09-29T23:05:13.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 Processor -- start 2023-09-29T23:05:13.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 -- start start 2023-09-29T23:05:13.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44003a60 0x7f9c580a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c580a1200 0x7f9c5809dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580a2250 0x7f9c5809e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5809f060 con 0x7f9c580a2250 2023-09-29T23:05:13.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580a0040 con 0x7f9c580a1200 2023-09-29T23:05:13.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e933700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580b2370 con 0x7f9c44003a60 2023-09-29T23:05:13.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5d931700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44003a60 0x7f9c580a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e132700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580a2250 0x7f9c5809e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5d931700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44003a60 0x7f9c580a0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33252/0 (socket says 172.21.15.115:33252) 2023-09-29T23:05:13.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e132700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580a2250 0x7f9c5809e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40936/0 (socket says 172.21.15.115:40936) 2023-09-29T23:05:13.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5d931700 1 -- 172.21.15.115:0/2682770535 learned_addr learned my addr 172.21.15.115:0/2682770535 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:13.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5d130700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c580a1200 0x7f9c5809dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5d931700 1 -- 172.21.15.115:0/2682770535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c580a1200 msgr2=0x7f9c5809dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5d931700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c580a1200 0x7f9c5809dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5d931700 1 -- 172.21.15.115:0/2682770535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580a2250 msgr2=0x7f9c5809e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5d931700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580a2250 0x7f9c5809e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5d931700 1 -- 172.21.15.115:0/2682770535 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5809fb80 con 0x7f9c44003a60 2023-09-29T23:05:13.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5e132700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580a2250 0x7f9c5809e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:13.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5d130700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c580a1200 0x7f9c5809dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:13.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.093+0000 7f9c5d931700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44003a60 0x7f9c580a0cc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c730 tx=0x7f9c54015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:13.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.101+0000 7f9c4dffb700 1 -- 172.21.15.115:0/2682770535 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400cc90 con 0x7f9c44003a60 2023-09-29T23:05:13.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.101+0000 7f9c4dffb700 1 -- 172.21.15.115:0/2682770535 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5400c9e0 con 0x7f9c44003a60 2023-09-29T23:05:13.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.101+0000 7f9c5e933700 1 -- 172.21.15.115:0/2682770535 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c580a0290 con 0x7f9c44003a60 2023-09-29T23:05:13.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.101+0000 7f9c4dffb700 1 -- 172.21.15.115:0/2682770535 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54007510 con 0x7f9c44003a60 2023-09-29T23:05:13.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.101+0000 7f9c5e933700 1 -- 172.21.15.115:0/2682770535 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5809f7f0 con 0x7f9c44003a60 2023-09-29T23:05:13.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.101+0000 7f9c5e933700 1 -- 172.21.15.115:0/2682770535 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5804be00 con 0x7f9c44003a60 2023-09-29T23:05:13.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.101+0000 7f9c4dffb700 1 -- 172.21.15.115:0/2682770535 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f9c54028460 con 0x7f9c44003a60 2023-09-29T23:05:13.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.101+0000 7f9c4dffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:13.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.101+0000 7f9c4dffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:13.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.101+0000 7f9c4dffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:13.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.101+0000 7f9c4dffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:13.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.101+0000 7f9c4dffb700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f9c3c08e900 0x7f9c3c090db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.105+0000 7f9c4dffb700 1 -- 172.21.15.115:0/2682770535 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f9c540b5c40 con 0x7f9c44003a60 2023-09-29T23:05:13.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.105+0000 7f9c5d130700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f9c3c08e900 0x7f9c3c090db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.105+0000 7f9c5d130700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f9c3c08e900 0x7f9c3c090db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c48006dc0 tx=0x7f9c48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:13.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.109+0000 7f9c4dffb700 1 -- 172.21.15.115:0/2682770535 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9c54086700 con 0x7f9c44003a60 2023-09-29T23:05:13.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.133+0000 7fd976c99700 1 Processor -- start 2023-09-29T23:05:13.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.133+0000 7fd976c99700 1 -- start start 2023-09-29T23:05:13.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd976c99700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013d760 0x7fd970149160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd976c99700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9700640d0 con 0x7fd97006f1c0 2023-09-29T23:05:13.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd976c99700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd970068150 con 0x7fd97006f590 2023-09-29T23:05:13.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd976c99700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd970067560 con 0x7fd97013d760 2023-09-29T23:05:13.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd975c97700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd97006f1c0 0x7fd970067a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41734/0 (socket says 172.21.15.115:41734) 2023-09-29T23:05:13.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd975c97700 1 -- 172.21.15.115:0/965256349 learned_addr learned my addr 172.21.15.115:0/965256349 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:13.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd976498700 1 --2- 172.21.15.115:0/965256349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013d760 0x7fd970149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148907606 0 0) 0x7fd9700640d0 con 0x7fd97006f1c0 2023-09-29T23:05:13.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd95c003570 con 0x7fd97006f1c0 2023-09-29T23:05:13.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4070250650 0 0) 0x7fd95c003570 con 0x7fd97006f1c0 2023-09-29T23:05:13.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013d760 msgr2=0x7fd970149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:13.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 --2- 172.21.15.115:0/965256349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013d760 0x7fd970149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 >> v1:172.21.15.156:6789/0 conn(0x7fd97006f590 legacy=0x7fd97013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97013dc60 con 0x7fd97006f1c0 2023-09-29T23:05:13.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3987234196 0 0) 0x7fd96c001470 con 0x7fd97006f1c0 2023-09-29T23:05:13.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 >> v1:172.21.15.115:6789/0 conn(0x7fd97006f1c0 legacy=0x7fd970067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 --2- 172.21.15.115:0/965256349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd95c003a90 0x7fd95c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 --2- 172.21.15.115:0/965256349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013d760 0x7fd95c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 --2- 172.21.15.115:0/965256349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd95c004d50 0x7fd95c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd970067560 con 0x7fd95c004d50 2023-09-29T23:05:13.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c00bb10 con 0x7fd95c003a90 2023-09-29T23:05:13.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c00bcd0 con 0x7fd97013d760 2023-09-29T23:05:13.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd975496700 1 --2- 172.21.15.115:0/965256349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013d760 0x7fd95c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd976498700 1 --2- 172.21.15.115:0/965256349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd95c004d50 0x7fd95c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd975c97700 1 --2- 172.21.15.115:0/965256349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd95c003a90 0x7fd95c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd976498700 1 -- 172.21.15.115:0/965256349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013d760 msgr2=0x7fd95c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:13.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd976498700 1 --2- 172.21.15.115:0/965256349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013d760 0x7fd95c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd976498700 1 -- 172.21.15.115:0/965256349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd95c003a90 msgr2=0x7fd95c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:13.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd976498700 1 --2- 172.21.15.115:0/965256349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd95c003a90 0x7fd95c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd976498700 1 -- 172.21.15.115:0/965256349 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c003570 con 0x7fd95c004d50 2023-09-29T23:05:13.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd975496700 1 --2- 172.21.15.115:0/965256349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013d760 0x7fd95c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:13.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd976498700 1 --2- 172.21.15.115:0/965256349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd95c004d50 0x7fd95c0051c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd97013db90 tx=0x7fd96800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e2d6974f624cf8 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:13.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968015070 con 0x7fd95c004d50 2023-09-29T23:05:13.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd968009bb0 con 0x7fd95c004d50 2023-09-29T23:05:13.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.137+0000 7fd974c95700 1 -- 172.21.15.115:0/965256349 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968019660 con 0x7fd95c004d50 2023-09-29T23:05:13.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 -- 172.21.15.115:0/965256349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd95c004d50 msgr2=0x7fd95c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 --2- 172.21.15.115:0/965256349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd95c004d50 0x7fd95c0051c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd97013db90 tx=0x7fd96800b040 comp rx=0 tx=0).stop 2023-09-29T23:05:13.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976498700 1 -- 172.21.15.115:0/965256349 reap_dead start 2023-09-29T23:05:13.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 -- 172.21.15.115:0/965256349 shutdown_connections 2023-09-29T23:05:13.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 -- 172.21.15.115:0/965256349 >> 172.21.15.115:0/965256349 conn(0x7fd9700a2a60 msgr2=0x7fd9700a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:13.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 -- 172.21.15.115:0/965256349 shutdown_connections 2023-09-29T23:05:13.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 -- 172.21.15.115:0/965256349 wait complete. 2023-09-29T23:05:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f29073e9700 1 Processor -- start 2023-09-29T23:05:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f29073e9700 1 -- start start 2023-09-29T23:05:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6eacc0700 1 Processor -- start 2023-09-29T23:05:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6eacc0700 1 -- start start 2023-09-29T23:05:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f29073e9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f290009e610 0x7f290009bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f29073e9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29001404f0 con 0x7f2900140120 2023-09-29T23:05:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f29073e9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f290009c4b0 con 0x7f290009ad70 2023-09-29T23:05:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f29073e9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f290009c750 con 0x7f290009e610 2023-09-29T23:05:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 Processor -- start 2023-09-29T23:05:13.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f2905185700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2900140120 0x7f29000680b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41742/0 (socket says 172.21.15.115:41742) 2023-09-29T23:05:13.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f2905185700 1 -- 172.21.15.115:0/1980188041 learned_addr learned my addr 172.21.15.115:0/1980188041 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:13.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 -- start start 2023-09-29T23:05:13.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f2904984700 1 --2- 172.21.15.115:0/1980188041 >> v2:172.21.15.115:3300/0 conn(0x7f290009e610 0x7f290009bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f28f7fff700 1 -- 172.21.15.115:0/1980188041 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484035584 0 0) 0x7f29001404f0 con 0x7f2900140120 2023-09-29T23:05:13.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f28f7fff700 1 -- 172.21.15.115:0/1980188041 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28ec003570 con 0x7f2900140120 2023-09-29T23:05:13.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6eacc0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e409d840 0x7fa6e413c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6eacc0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa6e413beb0 0x7fa6e4146960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f2904984700 1 -- 172.21.15.115:0/1980188041 >> v1:172.21.15.156:6789/0 conn(0x7f290009ad70 legacy=0x7f2900146910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f2904984700 1 -- 172.21.15.115:0/1980188041 >> v1:172.21.15.115:6789/0 conn(0x7f2900140120 legacy=0x7f29000680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f2904984700 1 -- 172.21.15.115:0/1980188041 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290006a420 con 0x7f290009e610 2023-09-29T23:05:13.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6eacc0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e4069ce0 con 0x7fa6e4069810 2023-09-29T23:05:13.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6eacc0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e4069f80 con 0x7fa6e413beb0 2023-09-29T23:05:13.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6eacc0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e409cb60 con 0x7fa6e409d840 2023-09-29T23:05:13.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6e8a5c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e409d840 0x7fa6e413c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6e3fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa6e4069810 0x7fa6e409dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:41748/0 (socket says 172.21.15.115:41748) 2023-09-29T23:05:13.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6e3fff700 1 -- 172.21.15.115:0/455307036 learned_addr learned my addr 172.21.15.115:0/455307036 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:13.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6e925d700 1 --2- 172.21.15.115:0/455307036 >> v2:172.21.15.156:3300/0 conn(0x7fa6e413beb0 0x7fa6e4146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f2904984700 1 --2- 172.21.15.115:0/1980188041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f290009e610 0x7f290009bb50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009e60 tx=0x7f28f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62436bace7981266 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:13.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97013c780 0x7fd9700ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9700b1340 0x7fd9700aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013a0b0 0x7fd97013a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700af160 con 0x7fd97013c780 2023-09-29T23:05:13.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700b1d40 con 0x7fd9700b1340 2023-09-29T23:05:13.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976c99700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97013cb50 con 0x7fd97013a0b0 2023-09-29T23:05:13.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f28f7fff700 1 -- 172.21.15.115:0/1980188041 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800e070 con 0x7f290009e610 2023-09-29T23:05:13.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6e925d700 1 -- 172.21.15.115:0/455307036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e409d840 msgr2=0x7fa6e413c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:13.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6e37fe700 1 -- 172.21.15.115:0/455307036 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737743698 0 0) 0x7fa6e4069ce0 con 0x7fa6e4069810 2023-09-29T23:05:13.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6e925d700 1 --2- 172.21.15.115:0/455307036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e409d840 0x7fa6e413c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6e925d700 1 -- 172.21.15.115:0/455307036 >> v1:172.21.15.115:6789/0 conn(0x7fa6e4069810 legacy=0x7fa6e409dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fa6e925d700 1 -- 172.21.15.115:0/455307036 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e413cef0 con 0x7fa6e413beb0 2023-09-29T23:05:13.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd975c97700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97013c780 0x7fd9700ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd975c97700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97013c780 0x7fd9700ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40958/0 (socket says 172.21.15.115:40958) 2023-09-29T23:05:13.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd975c97700 1 -- 172.21.15.115:0/162641390 learned_addr learned my addr 172.21.15.115:0/162641390 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:13.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976498700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013a0b0 0x7fd97013a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd975496700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9700b1340 0x7fd9700aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f28f7fff700 1 -- 172.21.15.115:0/1980188041 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f800bb60 con 0x7f290009e610 2023-09-29T23:05:13.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7f28f7fff700 1 -- 172.21.15.115:0/1980188041 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8012430 con 0x7f290009e610 2023-09-29T23:05:13.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976498700 1 -- 172.21.15.115:0/162641390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9700b1340 msgr2=0x7fd9700aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976498700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9700b1340 0x7fd9700aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976498700 1 -- 172.21.15.115:0/162641390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97013c780 msgr2=0x7fd9700ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976498700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97013c780 0x7fd9700ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd976498700 1 -- 172.21.15.115:0/162641390 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9700af630 con 0x7fd97013a0b0 2023-09-29T23:05:13.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.141+0000 7fd975c97700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97013c780 0x7fd9700ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:13.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fd976498700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013a0b0 0x7fd97013a520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd96801c000 tx=0x7fd96801a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:13.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fd965ffb700 1 -- 172.21.15.115:0/162641390 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968025070 con 0x7fd97013a0b0 2023-09-29T23:05:13.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 -- 172.21.15.115:0/1980188041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f290009e610 msgr2=0x7f290009bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 --2- 172.21.15.115:0/1980188041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f290009e610 0x7f290009bb50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009e60 tx=0x7f28f8009780 comp rx=0 tx=0).stop 2023-09-29T23:05:13.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fa6e925d700 1 --2- 172.21.15.115:0/455307036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e413beb0 0x7fa6e4146960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc009e60 tx=0x7fa6dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ad444526054e51 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:13.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 -- 172.21.15.115:0/1980188041 shutdown_connections 2023-09-29T23:05:13.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 --2- 172.21.15.115:0/1980188041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f290009e610 0x7f290009bb50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 -- 172.21.15.115:0/1980188041 >> 172.21.15.115:0/1980188041 conn(0x7f2900069550 msgr2=0x7f2900069950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:13.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fd965ffb700 1 -- 172.21.15.115:0/162641390 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96800f040 con 0x7fd97013a0b0 2023-09-29T23:05:13.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fd976c99700 1 -- 172.21.15.115:0/162641390 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9700af370 con 0x7fd97013a0b0 2023-09-29T23:05:13.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fd976c99700 1 -- 172.21.15.115:0/162641390 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97013d0b0 con 0x7fd97013a0b0 2023-09-29T23:05:13.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fd965ffb700 1 -- 172.21.15.115:0/162641390 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968018ab0 con 0x7fd97013a0b0 2023-09-29T23:05:13.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fa6e37fe700 1 -- 172.21.15.115:0/455307036 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00e070 con 0x7fa6e413beb0 2023-09-29T23:05:13.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fa6e37fe700 1 -- 172.21.15.115:0/455307036 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc00bb60 con 0x7fa6e413beb0 2023-09-29T23:05:13.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fa6e37fe700 1 -- 172.21.15.115:0/455307036 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc012430 con 0x7fa6e413beb0 2023-09-29T23:05:13.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 -- 172.21.15.115:0/1980188041 shutdown_connections 2023-09-29T23:05:13.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fa6eacc0700 1 -- 172.21.15.115:0/455307036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e413beb0 msgr2=0x7fa6e4146960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fa6eacc0700 1 --2- 172.21.15.115:0/455307036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e413beb0 0x7fa6e4146960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc009e60 tx=0x7fa6dc009780 comp rx=0 tx=0).stop 2023-09-29T23:05:13.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fa6eacc0700 1 -- 172.21.15.115:0/455307036 shutdown_connections 2023-09-29T23:05:13.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fa6eacc0700 1 --2- 172.21.15.115:0/455307036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e413beb0 0x7fa6e4146960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 -- 172.21.15.115:0/1980188041 wait complete. 2023-09-29T23:05:13.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fa6eacc0700 1 --2- 172.21.15.115:0/455307036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e409d840 0x7fa6e413c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fa6eacc0700 1 -- 172.21.15.115:0/455307036 >> 172.21.15.115:0/455307036 conn(0x7fa6e40a4880 msgr2=0x7fa6e40a27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:13.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fa6eacc0700 1 -- 172.21.15.115:0/455307036 shutdown_connections 2023-09-29T23:05:13.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fa6eacc0700 1 -- 172.21.15.115:0/455307036 wait complete. 2023-09-29T23:05:13.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 Processor -- start 2023-09-29T23:05:13.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 -- start start 2023-09-29T23:05:13.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fd965ffb700 1 -- 172.21.15.115:0/162641390 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fd968003040 con 0x7fd97013a0b0 2023-09-29T23:05:13.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fd965ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:13.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f290009ad70 0x7f29000a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f290009e610 0x7f29000a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2900140120 0x7f2900097130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2900096ca0 con 0x7f290009e610 2023-09-29T23:05:13.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29000a6310 con 0x7f290009ad70 2023-09-29T23:05:13.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7f29073e9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2900097b00 con 0x7f2900140120 2023-09-29T23:05:13.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.145+0000 7fa6eacc0700 1 Processor -- start 2023-09-29T23:05:13.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f2904984700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f290009e610 0x7f29000a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f2904984700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f290009e610 0x7f29000a0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40960/0 (socket says 172.21.15.115:40960) 2023-09-29T23:05:13.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f2904984700 1 -- 172.21.15.115:0/3038470585 learned_addr learned my addr 172.21.15.115:0/3038470585 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:13.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f2905986700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2900140120 0x7f2900097130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f2905185700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f290009ad70 0x7f29000a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6eacc0700 1 -- start start 2023-09-29T23:05:13.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fd965ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:13.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fd965ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:13.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fd965ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:13.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fd965ffb700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd95408e8b0 0x7fd954090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f2904984700 1 -- 172.21.15.115:0/3038470585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2900140120 msgr2=0x7f2900097130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f2904984700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2900140120 0x7f2900097130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f2904984700 1 -- 172.21.15.115:0/3038470585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f290009ad70 msgr2=0x7f29000a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f2904984700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f290009ad70 0x7f29000a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f2904984700 1 -- 172.21.15.115:0/3038470585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f8009a20 con 0x7f290009e610 2023-09-29T23:05:13.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fd965ffb700 1 -- 172.21.15.115:0/162641390 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fd9680b5820 con 0x7fd97013a0b0 2023-09-29T23:05:13.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f2905986700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2900140120 0x7f2900097130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:13.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fd975c97700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd95408e8b0 0x7fd954090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f2904984700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f290009e610 0x7f29000a0a80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f29001406a0 tx=0x7f28f8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:13.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f28f57fa700 1 -- 172.21.15.115:0/3038470585 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8012c50 con 0x7f290009e610 2023-09-29T23:05:13.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f28f57fa700 1 -- 172.21.15.115:0/3038470585 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f8012dd0 con 0x7f290009e610 2023-09-29T23:05:13.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f29073e9700 1 -- 172.21.15.115:0/3038470585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290014d4b0 con 0x7f290009e610 2023-09-29T23:05:13.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f28f57fa700 1 -- 172.21.15.115:0/3038470585 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80276c0 con 0x7f290009e610 2023-09-29T23:05:13.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f29073e9700 1 -- 172.21.15.115:0/3038470585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29000a1a10 con 0x7f290009e610 2023-09-29T23:05:13.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6eacc0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e4069810 0x7fa6e406f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6eacc0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e409d840 0x7fa6e4136270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6eacc0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e413beb0 0x7fa6e413a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6eacc0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e413e3e0 con 0x7fa6e413beb0 2023-09-29T23:05:13.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6eacc0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e4136cf0 con 0x7fa6e4069810 2023-09-29T23:05:13.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6eacc0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e4135510 con 0x7fa6e409d840 2023-09-29T23:05:13.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fd975c97700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd95408e8b0 0x7fd954090d60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0010e0 tx=0x7fd96c001e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:13.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e409d840 0x7fa6e4136270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e409d840 0x7fa6e4136270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33300/0 (socket says 172.21.15.115:33300) 2023-09-29T23:05:13.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e3fff700 1 -- 172.21.15.115:0/2412128698 learned_addr learned my addr 172.21.15.115:0/2412128698 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:13.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f29073e9700 1 -- 172.21.15.115:0/3038470585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2900070990 con 0x7f290009e610 2023-09-29T23:05:13.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e925d700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e413beb0 0x7fa6e413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e8a5c700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e4069810 0x7fa6e406f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e3fff700 1 -- 172.21.15.115:0/2412128698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e4069810 msgr2=0x7fa6e406f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e3fff700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e4069810 0x7fa6e406f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e3fff700 1 -- 172.21.15.115:0/2412128698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e413beb0 msgr2=0x7fa6e413a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e3fff700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e413beb0 0x7fa6e413a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e3fff700 1 -- 172.21.15.115:0/2412128698 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc009a20 con 0x7fa6e409d840 2023-09-29T23:05:13.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e8a5c700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e4069810 0x7fa6e406f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:13.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e3fff700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e409d840 0x7fa6e4136270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa6d400c7e0 tx=0x7fa6d4007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:13.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e0ff9700 1 -- 172.21.15.115:0/2412128698 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4005b30 con 0x7fa6e409d840 2023-09-29T23:05:13.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e0ff9700 1 -- 172.21.15.115:0/2412128698 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d4005c90 con 0x7fa6e409d840 2023-09-29T23:05:13.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6eacc0700 1 -- 172.21.15.115:0/2412128698 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e413d540 con 0x7fa6e409d840 2023-09-29T23:05:13.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6e0ff9700 1 -- 172.21.15.115:0/2412128698 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4007300 con 0x7fa6e409d840 2023-09-29T23:05:13.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7fa6eacc0700 1 -- 172.21.15.115:0/2412128698 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e413e660 con 0x7fa6e409d840 2023-09-29T23:05:13.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f28f57fa700 1 -- 172.21.15.115:0/3038470585 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f28f8024070 con 0x7f290009e610 2023-09-29T23:05:13.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f28f57fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:13.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f28f57fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:13.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f28f57fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:13.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f28f57fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:13.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.149+0000 7f28f57fa700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f28e408e8b0 0x7f28e4090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.153+0000 7f28f57fa700 1 -- 172.21.15.115:0/3038470585 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f28f80b6c60 con 0x7f290009e610 2023-09-29T23:05:13.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.153+0000 7fa6eacc0700 1 -- 172.21.15.115:0/2412128698 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c40050b0 con 0x7fa6e409d840 2023-09-29T23:05:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.153+0000 7f2905185700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f28e408e8b0 0x7f28e4090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.153+0000 7f2905185700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f28e408e8b0 0x7f28e4090d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28fc007fd0 tx=0x7f28fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:13.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.157+0000 7fd976c99700 1 -- 172.21.15.115:0/162641390 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9500050b0 con 0x7fd97013a0b0 2023-09-29T23:05:13.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.157+0000 7f28f57fa700 1 -- 172.21.15.115:0/3038470585 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f28f8087720 con 0x7f290009e610 2023-09-29T23:05:13.176 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.157+0000 7fa6e0ff9700 1 -- 172.21.15.115:0/2412128698 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fa6d40076b0 con 0x7fa6e409d840 2023-09-29T23:05:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.157+0000 7fa6e0ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.157+0000 7fa6e0ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.157+0000 7fa6e0ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.157+0000 7fa6e0ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.157+0000 7fa6e0ff9700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa6d008e8e0 0x7fa6d0090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.157+0000 7fa6e0ff9700 1 -- 172.21.15.115:0/2412128698 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fa6d40b4230 con 0x7fa6e409d840 2023-09-29T23:05:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.157+0000 7fa6e8a5c700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa6d008e8e0 0x7fa6d0090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:13.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.157+0000 7fa6e8a5c700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa6d008e8e0 0x7fa6d0090d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009d80 tx=0x7fa6d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.161+0000 7fa6e0ff9700 1 -- 172.21.15.115:0/2412128698 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa6d4084bc0 con 0x7fa6e409d840 2023-09-29T23:05:13.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.165+0000 7fd965ffb700 1 -- 172.21.15.115:0/162641390 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd9680862e0 con 0x7fd97013a0b0 2023-09-29T23:05:13.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.301+0000 7f9c5e933700 1 -- 172.21.15.115:0/2682770535 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9c5804be00 con 0x7f9c44003a60 2023-09-29T23:05:13.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.301+0000 7f9c4dffb700 1 -- 172.21.15.115:0/2682770535 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c54017070 con 0x7f9c44003a60 2023-09-29T23:05:13.304 INFO:teuthology.orchestra.run.smithi115.stdout:38654705668 2023-09-29T23:05:13.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.305+0000 7f9c5e933700 10 mgrc shutdown 2023-09-29T23:05:13.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.305+0000 7f9c5e933700 1 -- 172.21.15.115:0/2682770535 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f9c3c08e900 msgr2=0x7f9c3c090db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.305+0000 7f9c5e933700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f9c3c08e900 0x7f9c3c090db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c48006dc0 tx=0x7f9c48008040 comp rx=0 tx=0).stop 2023-09-29T23:05:13.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.305+0000 7f9c5e933700 1 -- 172.21.15.115:0/2682770535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44003a60 msgr2=0x7f9c580a0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.305+0000 7f9c5e933700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44003a60 0x7f9c580a0cc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c730 tx=0x7f9c54015000 comp rx=0 tx=0).stop 2023-09-29T23:05:13.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.305+0000 7f9c5e933700 1 -- 172.21.15.115:0/2682770535 shutdown_connections 2023-09-29T23:05:13.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.305+0000 7f9c5e933700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f9c3c08e900 0x7f9c3c090db0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.305+0000 7f9c5e933700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580a2250 0x7f9c5809e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.305+0000 7f9c5e933700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9c580a1200 0x7f9c5809dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.305+0000 7f9c5e933700 1 --2- 172.21.15.115:0/2682770535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44003a60 0x7f9c580a0cc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.305+0000 7f9c5e933700 1 -- 172.21.15.115:0/2682770535 >> 172.21.15.115:0/2682770535 conn(0x7f9c580a2a60 msgr2=0x7f9c58139030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:13.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.305+0000 7f9c5e933700 1 -- 172.21.15.115:0/2682770535 shutdown_connections 2023-09-29T23:05:13.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.305+0000 7f9c5e933700 1 -- 172.21.15.115:0/2682770535 wait complete. 2023-09-29T23:05:13.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2023-09-29T23:05:13.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.329+0000 7f29073e9700 1 -- 172.21.15.115:0/3038470585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f290009ccc0 con 0x7f290009e610 2023-09-29T23:05:13.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.329+0000 7f28f57fa700 1 -- 172.21.15.115:0/3038470585 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f28f808ad40 con 0x7f290009e610 2023-09-29T23:05:13.333 INFO:teuthology.orchestra.run.smithi115.stdout:38654705668 2023-09-29T23:05:13.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.333+0000 7f29073e9700 10 mgrc shutdown 2023-09-29T23:05:13.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.333+0000 7f29073e9700 1 -- 172.21.15.115:0/3038470585 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f28e408e8b0 msgr2=0x7f28e4090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.333+0000 7f29073e9700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f28e408e8b0 0x7f28e4090d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28fc007fd0 tx=0x7f28fc009040 comp rx=0 tx=0).stop 2023-09-29T23:05:13.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.333+0000 7f29073e9700 1 -- 172.21.15.115:0/3038470585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f290009e610 msgr2=0x7f29000a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.333+0000 7f29073e9700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f290009e610 0x7f29000a0a80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f29001406a0 tx=0x7f28f8019000 comp rx=0 tx=0).stop 2023-09-29T23:05:13.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.333+0000 7f29073e9700 1 -- 172.21.15.115:0/3038470585 shutdown_connections 2023-09-29T23:05:13.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.333+0000 7f29073e9700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2900140120 0x7f2900097130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.333+0000 7f29073e9700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f28e408e8b0 0x7f28e4090d60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.333+0000 7f29073e9700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f290009e610 0x7f29000a0a80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.333+0000 7f29073e9700 1 --2- 172.21.15.115:0/3038470585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f290009ad70 0x7f29000a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.336 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.333+0000 7f29073e9700 1 -- 172.21.15.115:0/3038470585 >> 172.21.15.115:0/3038470585 conn(0x7f2900069550 msgr2=0x7f29000b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:13.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.333+0000 7f29073e9700 1 -- 172.21.15.115:0/3038470585 shutdown_connections 2023-09-29T23:05:13.337 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.333+0000 7f29073e9700 1 -- 172.21.15.115:0/3038470585 wait complete. 2023-09-29T23:05:13.346 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.345+0000 7fa6eacc0700 1 -- 172.21.15.115:0/2412128698 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa6c4005630 con 0x7fa6e409d840 2023-09-29T23:05:13.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.345+0000 7fa6e0ff9700 1 -- 172.21.15.115:0/2412128698 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa6d4017070 con 0x7fa6e409d840 2023-09-29T23:05:13.347 INFO:teuthology.orchestra.run.smithi115.stdout:38654705668 2023-09-29T23:05:13.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2023-09-29T23:05:13.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.349+0000 7fa6eacc0700 10 mgrc shutdown 2023-09-29T23:05:13.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.349+0000 7fa6eacc0700 1 -- 172.21.15.115:0/2412128698 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa6d008e8e0 msgr2=0x7fa6d0090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.349+0000 7fa6eacc0700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa6d008e8e0 0x7fa6d0090d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009d80 tx=0x7fa6d8008040 comp rx=0 tx=0).stop 2023-09-29T23:05:13.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.349+0000 7fa6eacc0700 1 -- 172.21.15.115:0/2412128698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e409d840 msgr2=0x7fa6e4136270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.349+0000 7fa6eacc0700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e409d840 0x7fa6e4136270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa6d400c7e0 tx=0x7fa6d4007df0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.349+0000 7fa6eacc0700 1 -- 172.21.15.115:0/2412128698 shutdown_connections 2023-09-29T23:05:13.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.349+0000 7fa6eacc0700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa6d008e8e0 0x7fa6d0090d90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.349+0000 7fa6eacc0700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e413beb0 0x7fa6e413a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.349+0000 7fa6eacc0700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e409d840 0x7fa6e4136270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.349+0000 7fa6eacc0700 1 --2- 172.21.15.115:0/2412128698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e4069810 0x7fa6e406f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.349+0000 7fa6eacc0700 1 -- 172.21.15.115:0/2412128698 >> 172.21.15.115:0/2412128698 conn(0x7fa6e40a4880 msgr2=0x7fa6e40a2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:13.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.349+0000 7fa6eacc0700 1 -- 172.21.15.115:0/2412128698 shutdown_connections 2023-09-29T23:05:13.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.349+0000 7fa6eacc0700 1 -- 172.21.15.115:0/2412128698 wait complete. 2023-09-29T23:05:13.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.353+0000 7fd976c99700 1 -- 172.21.15.115:0/162641390 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd950005630 con 0x7fd97013a0b0 2023-09-29T23:05:13.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.353+0000 7fd965ffb700 1 -- 172.21.15.115:0/162641390 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd968089900 con 0x7fd97013a0b0 2023-09-29T23:05:13.356 INFO:teuthology.orchestra.run.smithi115.stdout:38654705668 2023-09-29T23:05:13.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.357+0000 7fd976c99700 10 mgrc shutdown 2023-09-29T23:05:13.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.357+0000 7fd976c99700 1 -- 172.21.15.115:0/162641390 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd95408e8b0 msgr2=0x7fd954090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.357+0000 7fd976c99700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd95408e8b0 0x7fd954090d60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0010e0 tx=0x7fd96c001e70 comp rx=0 tx=0).stop 2023-09-29T23:05:13.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.357+0000 7fd976c99700 1 -- 172.21.15.115:0/162641390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013a0b0 msgr2=0x7fd97013a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:13.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.357+0000 7fd976c99700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013a0b0 0x7fd97013a520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd96801c000 tx=0x7fd96801a000 comp rx=0 tx=0).stop 2023-09-29T23:05:13.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.357+0000 7fd976c99700 1 -- 172.21.15.115:0/162641390 shutdown_connections 2023-09-29T23:05:13.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.357+0000 7fd976c99700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd97013a0b0 0x7fd97013a520 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.357+0000 7fd976c99700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9700b1340 0x7fd9700aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.357+0000 7fd976c99700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd95408e8b0 0x7fd954090d60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.357+0000 7fd976c99700 1 --2- 172.21.15.115:0/162641390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97013c780 0x7fd9700ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:13.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.357+0000 7fd976c99700 1 -- 172.21.15.115:0/162641390 >> 172.21.15.115:0/162641390 conn(0x7fd9700a2a60 msgr2=0x7fd97006a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:13.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.357+0000 7fd976c99700 1 -- 172.21.15.115:0/162641390 shutdown_connections 2023-09-29T23:05:13.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:13.357+0000 7fd976c99700 1 -- 172.21.15.115:0/162641390 wait complete. 2023-09-29T23:05:13.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2023-09-29T23:05:13.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2023-09-29T23:05:14.321 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-29T23:05:14.350 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-29T23:05:14.362 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-29T23:05:14.369 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-29T23:05:14.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc12bf7700 1 Processor -- start 2023-09-29T23:05:14.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc12bf7700 1 -- start start 2023-09-29T23:05:14.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc12bf7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0c099910 0x7efc0c06a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc12bf7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efc0c13f990 0x7efc0c099ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc12bf7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c13fe30 con 0x7efc0c069a50 2023-09-29T23:05:14.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc12bf7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0c1400c0 con 0x7efc0c13f990 2023-09-29T23:05:14.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc12bf7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c140360 con 0x7efc0c099910 2023-09-29T23:05:14.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc11bf5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0c099910 0x7efc0c06a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc113f4700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efc0c069a50 0x7efc0c068660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34812/0 (socket says 172.21.15.115:34812) 2023-09-29T23:05:14.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc113f4700 1 -- 172.21.15.115:0/1855952399 learned_addr learned my addr 172.21.15.115:0/1855952399 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:14.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc11bf5700 1 --2- 172.21.15.115:0/1855952399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0c099910 0x7efc0c06a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:57434/0 (socket says 172.21.15.115:57434) 2023-09-29T23:05:14.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc123f6700 1 --2- 172.21.15.115:0/1855952399 >> v2:172.21.15.156:3300/0 conn(0x7efc0c13f990 0x7efc0c099ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc10bf3700 1 -- 172.21.15.115:0/1855952399 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107474192 0 0) 0x7efc0c13fe30 con 0x7efc0c069a50 2023-09-29T23:05:14.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc10bf3700 1 -- 172.21.15.115:0/1855952399 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbf8003570 con 0x7efc0c069a50 2023-09-29T23:05:14.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc11bf5700 1 -- 172.21.15.115:0/1855952399 >> v2:172.21.15.156:3300/0 conn(0x7efc0c13f990 msgr2=0x7efc0c099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:14.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc11bf5700 1 --2- 172.21.15.115:0/1855952399 >> v2:172.21.15.156:3300/0 conn(0x7efc0c13f990 0x7efc0c099ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc11bf5700 1 -- 172.21.15.115:0/1855952399 >> v1:172.21.15.115:6789/0 conn(0x7efc0c069a50 legacy=0x7efc0c068660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc11bf5700 1 -- 172.21.15.115:0/1855952399 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c09a220 con 0x7efc0c099910 2023-09-29T23:05:14.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc11bf5700 1 --2- 172.21.15.115:0/1855952399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0c099910 0x7efc0c06a1d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0098e0 tx=0x7efbfc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a870076b04309fe5 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:14.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.441+0000 7efc10bf3700 1 -- 172.21.15.115:0/1855952399 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc011630 con 0x7efc0c099910 2023-09-29T23:05:14.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.445+0000 7efc10bf3700 1 -- 172.21.15.115:0/1855952399 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc011790 con 0x7efc0c099910 2023-09-29T23:05:14.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.445+0000 7efc10bf3700 1 -- 172.21.15.115:0/1855952399 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc011b30 con 0x7efc0c099910 2023-09-29T23:05:14.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.445+0000 7efc12bf7700 1 -- 172.21.15.115:0/1855952399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0c099910 msgr2=0x7efc0c06a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.445+0000 7efc12bf7700 1 --2- 172.21.15.115:0/1855952399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0c099910 0x7efc0c06a1d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0098e0 tx=0x7efbfc0091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.445+0000 7efc12bf7700 1 -- 172.21.15.115:0/1855952399 shutdown_connections 2023-09-29T23:05:14.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.445+0000 7efc12bf7700 1 --2- 172.21.15.115:0/1855952399 >> v2:172.21.15.156:3300/0 conn(0x7efc0c13f990 0x7efc0c099ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.445+0000 7efc12bf7700 1 --2- 172.21.15.115:0/1855952399 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0c099910 0x7efc0c06a1d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.445+0000 7efc12bf7700 1 -- 172.21.15.115:0/1855952399 >> 172.21.15.115:0/1855952399 conn(0x7efc0c0a2a60 msgr2=0x7efc0c0a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:14.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.445+0000 7efc12bf7700 1 -- 172.21.15.115:0/1855952399 shutdown_connections 2023-09-29T23:05:14.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.445+0000 7efc12bf7700 1 -- 172.21.15.115:0/1855952399 wait complete. 2023-09-29T23:05:14.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.445+0000 7efc12bf7700 1 Processor -- start 2023-09-29T23:05:14.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.445+0000 7efc12bf7700 1 -- start start 2023-09-29T23:05:14.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc12bf7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc0c069a50 0x7efc0c1370b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc12bf7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc0c099910 0x7efc0c06f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc12bf7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0c13f990 0x7efc0c152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc12bf7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c06d9e0 con 0x7efc0c069a50 2023-09-29T23:05:14.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc12bf7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c06ff10 con 0x7efc0c099910 2023-09-29T23:05:14.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc12bf7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c06dc10 con 0x7efc0c13f990 2023-09-29T23:05:14.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc11bf5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc0c069a50 0x7efc0c1370b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc11bf5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc0c069a50 0x7efc0c1370b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37388/0 (socket says 172.21.15.115:37388) 2023-09-29T23:05:14.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc11bf5700 1 -- 172.21.15.115:0/2830777606 learned_addr learned my addr 172.21.15.115:0/2830777606 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:14.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc123f6700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0c13f990 0x7efc0c152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc113f4700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc0c099910 0x7efc0c06f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc11bf5700 1 -- 172.21.15.115:0/2830777606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0c13f990 msgr2=0x7efc0c152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc11bf5700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0c13f990 0x7efc0c152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc11bf5700 1 -- 172.21.15.115:0/2830777606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc0c099910 msgr2=0x7efc0c06f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc11bf5700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc0c099910 0x7efc0c06f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc11bf5700 1 -- 172.21.15.115:0/2830777606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc009420 con 0x7efc0c069a50 2023-09-29T23:05:14.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc123f6700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0c13f990 0x7efc0c152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:14.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc113f4700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc0c099910 0x7efc0c06f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:14.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc11bf5700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc0c069a50 0x7efc0c1370b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009ed0 tx=0x7efbfc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:14.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc01ffb700 1 -- 172.21.15.115:0/2830777606 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc000d10 con 0x7efc0c069a50 2023-09-29T23:05:14.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc01ffb700 1 -- 172.21.15.115:0/2830777606 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc011b10 con 0x7efc0c069a50 2023-09-29T23:05:14.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc12bf7700 1 -- 172.21.15.115:0/2830777606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0c06ded0 con 0x7efc0c069a50 2023-09-29T23:05:14.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc01ffb700 1 -- 172.21.15.115:0/2830777606 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc025620 con 0x7efc0c069a50 2023-09-29T23:05:14.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.449+0000 7efc12bf7700 1 -- 172.21.15.115:0/2830777606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0c06d160 con 0x7efc0c069a50 2023-09-29T23:05:14.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.453+0000 7efc12bf7700 1 -- 172.21.15.115:0/2830777606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0c04be00 con 0x7efc0c069a50 2023-09-29T23:05:14.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.453+0000 7efc01ffb700 1 -- 172.21.15.115:0/2830777606 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7efbfc025a50 con 0x7efc0c069a50 2023-09-29T23:05:14.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.453+0000 7efc01ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:14.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.453+0000 7efc01ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:14.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.453+0000 7efc01ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:14.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.453+0000 7efc01ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:14.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.453+0000 7efc01ffb700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efbf008e8e0 0x7efbf0090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.453+0000 7efc01ffb700 1 -- 172.21.15.115:0/2830777606 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7efbfc0b5f20 con 0x7efc0c069a50 2023-09-29T23:05:14.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.453+0000 7efc113f4700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efbf008e8e0 0x7efbf0090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.453+0000 7efc113f4700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efbf008e8e0 0x7efbf0090d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc0c062c60 tx=0x7efc08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:14.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.457+0000 7efc01ffb700 1 -- 172.21.15.115:0/2830777606 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efbfc086940 con 0x7efc0c069a50 2023-09-29T23:05:14.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2ffff700 1 Processor -- start 2023-09-29T23:05:14.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2ffff700 1 -- start start 2023-09-29T23:05:14.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c3009d6a0 0x7f3c3009daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2ffff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c300686b0 con 0x7f3c300afc90 2023-09-29T23:05:14.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2ffff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3009e330 con 0x7f3c300682e0 2023-09-29T23:05:14.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2ffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3009e5f0 con 0x7f3c3009d6a0 2023-09-29T23:05:14.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2e7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c3009d6a0 0x7f3c3009daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2e7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c3009d6a0 0x7f3c3009daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:57452/0 (socket says 172.21.15.115:57452) 2023-09-29T23:05:14.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3c300afc90 0x7f3c300b0110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34828/0 (socket says 172.21.15.115:34828) 2023-09-29T23:05:14.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2e7fc700 1 -- 172.21.15.115:0/1134912878 learned_addr learned my addr 172.21.15.115:0/1134912878 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:14.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2e7fc700 1 -- 172.21.15.115:0/1134912878 >> v1:172.21.15.156:6789/0 conn(0x7f3c300682e0 legacy=0x7f3c3009c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2e7fc700 1 -- 172.21.15.115:0/1134912878 >> v1:172.21.15.115:6789/0 conn(0x7f3c300afc90 legacy=0x7f3c300b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2dffb700 1 -- 172.21.15.115:0/1134912878 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948434017 0 0) 0x7f3c300686b0 con 0x7f3c300afc90 2023-09-29T23:05:14.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2e7fc700 1 -- 172.21.15.115:0/1134912878 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3009dfe0 con 0x7f3c3009d6a0 2023-09-29T23:05:14.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2e7fc700 1 --2- 172.21.15.115:0/1134912878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c3009d6a0 0x7f3c3009daa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000ab80 tx=0x7f3c2000a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1000c64c85b2c9ae server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:14.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2dffb700 1 -- 172.21.15.115:0/1134912878 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2000caa0 con 0x7f3c3009d6a0 2023-09-29T23:05:14.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2dffb700 1 -- 172.21.15.115:0/1134912878 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2000cc00 con 0x7f3c3009d6a0 2023-09-29T23:05:14.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.477+0000 7f3c2dffb700 1 -- 172.21.15.115:0/1134912878 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20018400 con 0x7f3c3009d6a0 2023-09-29T23:05:14.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 -- 172.21.15.115:0/1134912878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c3009d6a0 msgr2=0x7f3c3009daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 --2- 172.21.15.115:0/1134912878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c3009d6a0 0x7f3c3009daa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000ab80 tx=0x7f3c2000a3f0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 -- 172.21.15.115:0/1134912878 shutdown_connections 2023-09-29T23:05:14.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 --2- 172.21.15.115:0/1134912878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c3009d6a0 0x7f3c3009daa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 -- 172.21.15.115:0/1134912878 >> 172.21.15.115:0/1134912878 conn(0x7f3c300692c0 msgr2=0x7f3c300696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:14.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 -- 172.21.15.115:0/1134912878 shutdown_connections 2023-09-29T23:05:14.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 -- 172.21.15.115:0/1134912878 wait complete. 2023-09-29T23:05:14.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 Processor -- start 2023-09-29T23:05:14.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 -- start start 2023-09-29T23:05:14.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c300682e0 0x7f3c3014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c300afc90 0x7f3c3006efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c3014be00 0x7f3c3015e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3006ebf0 con 0x7f3c300afc90 2023-09-29T23:05:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3006f520 con 0x7f3c300682e0 2023-09-29T23:05:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2ffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3014c7a0 con 0x7f3c3014be00 2023-09-29T23:05:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2e7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c300afc90 0x7f3c3006efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2e7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c300afc90 0x7f3c3006efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37400/0 (socket says 172.21.15.115:37400) 2023-09-29T23:05:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c3014be00 0x7f3c3015e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2e7fc700 1 -- 172.21.15.115:0/571247678 learned_addr learned my addr 172.21.15.115:0/571247678 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2effd700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c300682e0 0x7f3c3014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2f7fe700 1 -- 172.21.15.115:0/571247678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c300682e0 msgr2=0x7f3c3014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2f7fe700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c300682e0 0x7f3c3014acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2f7fe700 1 -- 172.21.15.115:0/571247678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c300afc90 msgr2=0x7f3c3006efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2f7fe700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c300afc90 0x7f3c3006efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2f7fe700 1 -- 172.21.15.115:0/571247678 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2000a690 con 0x7f3c3014be00 2023-09-29T23:05:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.481+0000 7f3c2e7fc700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c300afc90 0x7f3c3006efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.485+0000 7f3c2f7fe700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c3014be00 0x7f3c3015e9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400c510 tx=0x7f3c24007ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.485+0000 7f3c16ffd700 1 -- 172.21.15.115:0/571247678 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2400ce80 con 0x7f3c3014be00 2023-09-29T23:05:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.485+0000 7f3c16ffd700 1 -- 172.21.15.115:0/571247678 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c24005a70 con 0x7f3c3014be00 2023-09-29T23:05:14.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.485+0000 7f3c2ffff700 1 -- 172.21.15.115:0/571247678 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3015e580 con 0x7f3c3014be00 2023-09-29T23:05:14.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.485+0000 7f3c16ffd700 1 -- 172.21.15.115:0/571247678 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24005e10 con 0x7f3c3014be00 2023-09-29T23:05:14.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.485+0000 7f3c2ffff700 1 -- 172.21.15.115:0/571247678 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3006dbf0 con 0x7f3c3014be00 2023-09-29T23:05:14.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.485+0000 7f3c2ffff700 1 -- 172.21.15.115:0/571247678 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3004be00 con 0x7f3c3014be00 2023-09-29T23:05:14.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.485+0000 7f3c16ffd700 1 -- 172.21.15.115:0/571247678 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f3c240072e0 con 0x7f3c3014be00 2023-09-29T23:05:14.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.485+0000 7f3c16ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:14.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.489+0000 7f3c16ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:14.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.489+0000 7f3c16ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:14.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.489+0000 7f3c16ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:14.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.489+0000 7f3c16ffd700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3c1c08e8e0 0x7f3c1c090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.489+0000 7f3c16ffd700 1 -- 172.21.15.115:0/571247678 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f3c240b3b60 con 0x7f3c3014be00 2023-09-29T23:05:14.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.489+0000 7f3c2effd700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3c1c08e8e0 0x7f3c1c090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.489+0000 7f3c2effd700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3c1c08e8e0 0x7f3c1c090d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3c28007fd0 tx=0x7f3c280016f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:14.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.493+0000 7f3c16ffd700 1 -- 172.21.15.115:0/571247678 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3c24084590 con 0x7f3c3014be00 2023-09-29T23:05:14.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefacc7f700 1 Processor -- start 2023-09-29T23:05:14.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefacc7f700 1 -- start start 2023-09-29T23:05:14.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefacc7f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fefa80682e0 0x7fefa80a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefacc7f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa80686b0 con 0x7fefa80a4540 2023-09-29T23:05:14.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefacc7f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa8143480 con 0x7fefa80a4120 2023-09-29T23:05:14.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefacc7f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa80a2fd0 con 0x7fefa80682e0 2023-09-29T23:05:14.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefa6d9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fefa80a4540 0x7fefa814a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34830/0 (socket says 172.21.15.115:34830) 2023-09-29T23:05:14.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefa659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fefa80682e0 0x7fefa80a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefa6d9d700 1 -- 172.21.15.115:0/1348796538 learned_addr learned my addr 172.21.15.115:0/1348796538 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:14.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefa559a700 1 -- 172.21.15.115:0/1348796538 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661125207 0 0) 0x7fefa80686b0 con 0x7fefa80a4540 2023-09-29T23:05:14.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefa559a700 1 -- 172.21.15.115:0/1348796538 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef90003570 con 0x7fefa80a4540 2023-09-29T23:05:14.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefa659c700 1 -- 172.21.15.115:0/1348796538 >> v1:172.21.15.156:6789/0 conn(0x7fefa80a4120 legacy=0x7fefa809dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefa659c700 1 -- 172.21.15.115:0/1348796538 >> v1:172.21.15.115:6789/0 conn(0x7fefa80a4540 legacy=0x7fefa814a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefa659c700 1 -- 172.21.15.115:0/1348796538 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa8143720 con 0x7fefa80682e0 2023-09-29T23:05:14.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7f47905ed700 1 Processor -- start 2023-09-29T23:05:14.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7f47905ed700 1 -- start start 2023-09-29T23:05:14.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefa659c700 1 --2- 172.21.15.115:0/1348796538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefa80682e0 0x7fefa80a2a90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fef980098e0 tx=0x7fef980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95d1e665b7c9c2b server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:14.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.501+0000 7fefa559a700 1 -- 172.21.15.115:0/1348796538 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800b640 con 0x7fefa80682e0 2023-09-29T23:05:14.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefa559a700 1 -- 172.21.15.115:0/1348796538 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9800b7a0 con 0x7fefa80682e0 2023-09-29T23:05:14.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefa559a700 1 -- 172.21.15.115:0/1348796538 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800bb40 con 0x7fefa80682e0 2023-09-29T23:05:14.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f478806be20 0x7f47880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f478806c1f0 0x7f47880670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f47880a5000 0x7f4788067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47880675e0 con 0x7f478806be20 2023-09-29T23:05:14.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47880a5d90 con 0x7f47880a5000 2023-09-29T23:05:14.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47880a6050 con 0x7f478806c1f0 2023-09-29T23:05:14.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478e389700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f478806be20 0x7f47880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478db88700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f478806c1f0 0x7f47880670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478e389700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f478806be20 0x7f47880a5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37420/0 (socket says 172.21.15.115:37420) 2023-09-29T23:05:14.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478e389700 1 -- 172.21.15.115:0/389882422 learned_addr learned my addr 172.21.15.115:0/389882422 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:14.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478db88700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f478806c1f0 0x7f47880670a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:57472/0 (socket says 172.21.15.115:57472) 2023-09-29T23:05:14.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478eb8a700 1 --2- 172.21.15.115:0/389882422 >> v2:172.21.15.156:3300/0 conn(0x7f47880a5000 0x7f4788067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478e389700 1 -- 172.21.15.115:0/389882422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f478806c1f0 msgr2=0x7f47880670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:14.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478e389700 1 --2- 172.21.15.115:0/389882422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f478806c1f0 0x7f47880670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478e389700 1 -- 172.21.15.115:0/389882422 >> v2:172.21.15.156:3300/0 conn(0x7f47880a5000 msgr2=0x7f4788067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:14.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478e389700 1 --2- 172.21.15.115:0/389882422 >> v2:172.21.15.156:3300/0 conn(0x7f47880a5000 0x7f4788067ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478e389700 1 -- 172.21.15.115:0/389882422 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4788067ff0 con 0x7f478806be20 2023-09-29T23:05:14.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 -- 172.21.15.115:0/1348796538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefa80682e0 msgr2=0x7fefa80a2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 --2- 172.21.15.115:0/1348796538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefa80682e0 0x7fefa80a2a90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fef980098e0 tx=0x7fef980091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478eb8a700 1 --2- 172.21.15.115:0/389882422 >> v2:172.21.15.156:3300/0 conn(0x7f47880a5000 0x7f4788067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:14.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478db88700 1 --2- 172.21.15.115:0/389882422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f478806c1f0 0x7f47880670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:14.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 -- 172.21.15.115:0/1348796538 shutdown_connections 2023-09-29T23:05:14.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 --2- 172.21.15.115:0/1348796538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefa80682e0 0x7fefa80a2a90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 -- 172.21.15.115:0/1348796538 >> 172.21.15.115:0/1348796538 conn(0x7fefa80b1ef0 msgr2=0x7fefa80b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:14.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478e389700 1 --2- 172.21.15.115:0/389882422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f478806be20 0x7f47880a5790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f478806b6e0 tx=0x7f4780009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ff96c2ee0a18ef server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:14.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 -- 172.21.15.115:0/1348796538 shutdown_connections 2023-09-29T23:05:14.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 -- 172.21.15.115:0/1348796538 wait complete. 2023-09-29T23:05:14.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478d387700 1 -- 172.21.15.115:0/389882422 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478000e070 con 0x7f478806be20 2023-09-29T23:05:14.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478d387700 1 -- 172.21.15.115:0/389882422 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478000ba20 con 0x7f478806be20 2023-09-29T23:05:14.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f478d387700 1 -- 172.21.15.115:0/389882422 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47800092e0 con 0x7f478806be20 2023-09-29T23:05:14.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 -- 172.21.15.115:0/389882422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f478806be20 msgr2=0x7f47880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 --2- 172.21.15.115:0/389882422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f478806be20 0x7f47880a5790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f478806b6e0 tx=0x7f4780009840 comp rx=0 tx=0).stop 2023-09-29T23:05:14.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 -- 172.21.15.115:0/389882422 shutdown_connections 2023-09-29T23:05:14.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 --2- 172.21.15.115:0/389882422 >> v2:172.21.15.156:3300/0 conn(0x7f47880a5000 0x7f4788067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 --2- 172.21.15.115:0/389882422 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f478806c1f0 0x7f47880670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 --2- 172.21.15.115:0/389882422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f478806be20 0x7f47880a5790 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 -- 172.21.15.115:0/389882422 >> 172.21.15.115:0/389882422 conn(0x7f47880b4bc0 msgr2=0x7f478806b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:14.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 -- 172.21.15.115:0/389882422 shutdown_connections 2023-09-29T23:05:14.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 -- 172.21.15.115:0/389882422 wait complete. 2023-09-29T23:05:14.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 Processor -- start 2023-09-29T23:05:14.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 -- start start 2023-09-29T23:05:14.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 Processor -- start 2023-09-29T23:05:14.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 -- start start 2023-09-29T23:05:14.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefa80682e0 0x7fefa809d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefa80a4120 0x7fefa80a63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fefa80a4540 0x7fefa8153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa814fb30 con 0x7fefa80a4120 2023-09-29T23:05:14.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8153d90 con 0x7fefa80682e0 2023-09-29T23:05:14.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefacc7f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8154050 con 0x7fefa80a4540 2023-09-29T23:05:14.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f478806be20 0x7f4788099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f478806c1f0 0x7f4788141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47880a5000 0x7f47881422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478809a4d0 con 0x7f478806be20 2023-09-29T23:05:14.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47881427f0 con 0x7f47880a5000 2023-09-29T23:05:14.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7f47905ed700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478809edf0 con 0x7f478806c1f0 2023-09-29T23:05:14.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.505+0000 7fefa5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefa80a4120 0x7fefa80a63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fefa5d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefa80a4120 0x7fefa80a63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37430/0 (socket says 172.21.15.115:37430) 2023-09-29T23:05:14.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fefa5d9b700 1 -- 172.21.15.115:0/1681600420 learned_addr learned my addr 172.21.15.115:0/1681600420 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:14.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fefa659c700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefa80682e0 0x7fefa809d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f478e389700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f478806be20 0x7f4788099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f478db88700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f478806c1f0 0x7f4788141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f478e389700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f478806be20 0x7f4788099f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37432/0 (socket says 172.21.15.115:37432) 2023-09-29T23:05:14.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f478e389700 1 -- 172.21.15.115:0/1105987156 learned_addr learned my addr 172.21.15.115:0/1105987156 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:14.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f478eb8a700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47880a5000 0x7f47881422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f478db88700 1 -- 172.21.15.115:0/1105987156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47880a5000 msgr2=0x7f47881422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f478db88700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47880a5000 0x7f47881422b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f478db88700 1 -- 172.21.15.115:0/1105987156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f478806be20 msgr2=0x7f4788099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f478db88700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f478806be20 0x7f4788099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f478db88700 1 -- 172.21.15.115:0/1105987156 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784009420 con 0x7f478806c1f0 2023-09-29T23:05:14.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f478e389700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f478806be20 0x7f4788099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:14.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fefa5d9b700 1 -- 172.21.15.115:0/1681600420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fefa80a4540 msgr2=0x7fefa8153230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-29T23:05:14.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fefa5d9b700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fefa80a4540 0x7fefa8153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fefa5d9b700 1 -- 172.21.15.115:0/1681600420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefa80682e0 msgr2=0x7fefa809d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fefa5d9b700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefa80682e0 0x7fefa809d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fefa5d9b700 1 -- 172.21.15.115:0/1681600420 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98009420 con 0x7fefa80a4120 2023-09-29T23:05:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fefa659c700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefa80682e0 0x7fefa809d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fefa5d9b700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefa80a4120 0x7fefa80a63b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00c590 tx=0x7fef9c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f478db88700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f478806c1f0 0x7f4788141d70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f478400ec80 tx=0x7f47840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fef967fc700 1 -- 172.21.15.115:0/1681600420 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c011590 con 0x7fefa80a4120 2023-09-29T23:05:14.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fef967fc700 1 -- 172.21.15.115:0/1681600420 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c0116f0 con 0x7fefa80a4120 2023-09-29T23:05:14.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fef967fc700 1 -- 172.21.15.115:0/1681600420 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c011ab0 con 0x7fefa80a4120 2023-09-29T23:05:14.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fefacc7f700 1 -- 172.21.15.115:0/1681600420 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa80a68f0 con 0x7fefa80a4120 2023-09-29T23:05:14.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fefacc7f700 1 -- 172.21.15.115:0/1681600420 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa809dfd0 con 0x7fefa80a4120 2023-09-29T23:05:14.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f477e7fc700 1 -- 172.21.15.115:0/1105987156 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400c850 con 0x7f478806c1f0 2023-09-29T23:05:14.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f477e7fc700 1 -- 172.21.15.115:0/1105987156 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478400c9b0 con 0x7f478806c1f0 2023-09-29T23:05:14.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f47905ed700 1 -- 172.21.15.115:0/1105987156 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4780009ae0 con 0x7f478806c1f0 2023-09-29T23:05:14.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f477e7fc700 1 -- 172.21.15.115:0/1105987156 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400cd70 con 0x7f478806c1f0 2023-09-29T23:05:14.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7f47905ed700 1 -- 172.21.15.115:0/1105987156 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4788098e10 con 0x7f478806c1f0 2023-09-29T23:05:14.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fef967fc700 1 -- 172.21.15.115:0/1681600420 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fef9c01b3b0 con 0x7fefa80a4120 2023-09-29T23:05:14.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fef967fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:14.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fef967fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:14.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.509+0000 7fef967fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:14.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7fef967fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:14.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7fef967fc700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef8808e8e0 0x7fef88090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7f47905ed700 1 -- 172.21.15.115:0/1105987156 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4788070990 con 0x7f478806c1f0 2023-09-29T23:05:14.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7fef967fc700 1 -- 172.21.15.115:0/1681600420 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fef9c0b3c80 con 0x7fefa80a4120 2023-09-29T23:05:14.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7fefa659c700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef8808e8e0 0x7fef88090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7f477e7fc700 1 -- 172.21.15.115:0/1105987156 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f4784013680 con 0x7f478806c1f0 2023-09-29T23:05:14.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7f477e7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:14.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7fefa659c700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef8808e8e0 0x7fef88090d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fef980093f0 tx=0x7fef98017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:14.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7f477e7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:14.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7f477e7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:14.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7f477e7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:14.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7f477e7fc700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f476c08e830 0x7f476c090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:14.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7f477e7fc700 1 -- 172.21.15.115:0/1105987156 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f47840b4a20 con 0x7f478806c1f0 2023-09-29T23:05:14.525 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7f478e389700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f476c08e830 0x7f476c090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:14.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.513+0000 7f478e389700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f476c08e830 0x7f476c090ce0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4780009ab0 tx=0x7f4780018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:14.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.517+0000 7fefacc7f700 1 -- 172.21.15.115:0/1681600420 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa80a6b60 con 0x7fefa80a4120 2023-09-29T23:05:14.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.517+0000 7f477e7fc700 1 -- 172.21.15.115:0/1105987156 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4784085450 con 0x7f478806c1f0 2023-09-29T23:05:14.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.521+0000 7fef967fc700 1 -- 172.21.15.115:0/1681600420 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fef9c017020 con 0x7fefa80a4120 2023-09-29T23:05:14.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.657+0000 7f3c2ffff700 1 -- 172.21.15.115:0/571247678 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3c300b0dc0 con 0x7f3c3014be00 2023-09-29T23:05:14.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.657+0000 7f3c16ffd700 1 -- 172.21.15.115:0/571247678 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c24017070 con 0x7f3c3014be00 2023-09-29T23:05:14.660 INFO:teuthology.orchestra.run.smithi115.stdout:38654705668 2023-09-29T23:05:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.661+0000 7f3c2ffff700 10 mgrc shutdown 2023-09-29T23:05:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.661+0000 7f3c2ffff700 1 -- 172.21.15.115:0/571247678 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3c1c08e8e0 msgr2=0x7f3c1c090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.661+0000 7f3c2ffff700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3c1c08e8e0 0x7f3c1c090d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3c28007fd0 tx=0x7f3c280016f0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.661+0000 7f3c2ffff700 1 -- 172.21.15.115:0/571247678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c3014be00 msgr2=0x7f3c3015e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.661+0000 7f3c2ffff700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c3014be00 0x7f3c3015e9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400c510 tx=0x7f3c24007ed0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.661+0000 7f3c2ffff700 1 -- 172.21.15.115:0/571247678 shutdown_connections 2023-09-29T23:05:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.661+0000 7f3c2ffff700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c3014be00 0x7f3c3015e9d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.661+0000 7f3c2ffff700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3c1c08e8e0 0x7f3c1c090d90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.661+0000 7f3c2ffff700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c300afc90 0x7f3c3006efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.661+0000 7f3c2ffff700 1 --2- 172.21.15.115:0/571247678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c300682e0 0x7f3c3014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.661+0000 7f3c2ffff700 1 -- 172.21.15.115:0/571247678 >> 172.21.15.115:0/571247678 conn(0x7f3c300692c0 msgr2=0x7f3c300a2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:14.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.661+0000 7f3c2ffff700 1 -- 172.21.15.115:0/571247678 shutdown_connections 2023-09-29T23:05:14.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.661+0000 7f3c2ffff700 1 -- 172.21.15.115:0/571247678 wait complete. 2023-09-29T23:05:14.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2023-09-29T23:05:14.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.677+0000 7efc12bf7700 1 -- 172.21.15.115:0/2830777606 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efc0c0a36b0 con 0x7efc0c069a50 2023-09-29T23:05:14.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.677+0000 7efc01ffb700 1 -- 172.21.15.115:0/2830777606 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efbfc015090 con 0x7efc0c069a50 2023-09-29T23:05:14.680 INFO:teuthology.orchestra.run.smithi115.stdout:38654705668 2023-09-29T23:05:14.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.681+0000 7efc12bf7700 10 mgrc shutdown 2023-09-29T23:05:14.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.681+0000 7efc12bf7700 1 -- 172.21.15.115:0/2830777606 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efbf008e8e0 msgr2=0x7efbf0090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.681+0000 7efc12bf7700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efbf008e8e0 0x7efbf0090d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc0c062c60 tx=0x7efc08009040 comp rx=0 tx=0).stop 2023-09-29T23:05:14.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.681+0000 7efc12bf7700 1 -- 172.21.15.115:0/2830777606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc0c069a50 msgr2=0x7efc0c1370b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.681+0000 7efc12bf7700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc0c069a50 0x7efc0c1370b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009ed0 tx=0x7efbfc017000 comp rx=0 tx=0).stop 2023-09-29T23:05:14.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.681+0000 7efc12bf7700 1 -- 172.21.15.115:0/2830777606 shutdown_connections 2023-09-29T23:05:14.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.681+0000 7efc12bf7700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc0c13f990 0x7efc0c152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.681+0000 7efc12bf7700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc0c099910 0x7efc0c06f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.684 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.681+0000 7efc12bf7700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efbf008e8e0 0x7efbf0090d90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.681+0000 7efc12bf7700 1 --2- 172.21.15.115:0/2830777606 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc0c069a50 0x7efc0c1370b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.681+0000 7efc12bf7700 1 -- 172.21.15.115:0/2830777606 >> 172.21.15.115:0/2830777606 conn(0x7efc0c0a2a60 msgr2=0x7efc0c0670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:14.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.681+0000 7efc12bf7700 1 -- 172.21.15.115:0/2830777606 shutdown_connections 2023-09-29T23:05:14.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.681+0000 7efc12bf7700 1 -- 172.21.15.115:0/2830777606 wait complete. 2023-09-29T23:05:14.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.689+0000 7fefacc7f700 1 -- 172.21.15.115:0/1681600420 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fefa8070990 con 0x7fefa80a4120 2023-09-29T23:05:14.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.689+0000 7fef967fc700 1 -- 172.21.15.115:0/1681600420 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef9c0881d0 con 0x7fefa80a4120 2023-09-29T23:05:14.692 INFO:teuthology.orchestra.run.smithi115.stdout:38654705668 2023-09-29T23:05:14.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2023-09-29T23:05:14.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.693+0000 7fefacc7f700 10 mgrc shutdown 2023-09-29T23:05:14.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.693+0000 7fefacc7f700 1 -- 172.21.15.115:0/1681600420 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef8808e8e0 msgr2=0x7fef88090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.693+0000 7fefacc7f700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef8808e8e0 0x7fef88090d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fef980093f0 tx=0x7fef98017000 comp rx=0 tx=0).stop 2023-09-29T23:05:14.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.693+0000 7fefacc7f700 1 -- 172.21.15.115:0/1681600420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefa80a4120 msgr2=0x7fefa80a63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.693+0000 7fefacc7f700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefa80a4120 0x7fefa80a63b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00c590 tx=0x7fef9c00c950 comp rx=0 tx=0).stop 2023-09-29T23:05:14.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.693+0000 7fefacc7f700 1 -- 172.21.15.115:0/1681600420 shutdown_connections 2023-09-29T23:05:14.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.693+0000 7fefacc7f700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fefa80a4540 0x7fefa8153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.693+0000 7fefacc7f700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef8808e8e0 0x7fef88090d90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.693+0000 7fefacc7f700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefa80a4120 0x7fefa80a63b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.693+0000 7fefacc7f700 1 --2- 172.21.15.115:0/1681600420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefa80682e0 0x7fefa809d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.693+0000 7fefacc7f700 1 -- 172.21.15.115:0/1681600420 >> 172.21.15.115:0/1681600420 conn(0x7fefa80b1ef0 msgr2=0x7fefa80b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:14.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.693+0000 7fefacc7f700 1 -- 172.21.15.115:0/1681600420 shutdown_connections 2023-09-29T23:05:14.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.693+0000 7fefacc7f700 1 -- 172.21.15.115:0/1681600420 wait complete. 2023-09-29T23:05:14.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2023-09-29T23:05:14.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 1 -- 172.21.15.115:0/1105987156 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f47880a6900 con 0x7f478806c1f0 2023-09-29T23:05:14.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f477e7fc700 1 -- 172.21.15.115:0/1105987156 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4784021020 con 0x7f478806c1f0 2023-09-29T23:05:14.715 INFO:teuthology.orchestra.run.smithi115.stdout:38654705668 2023-09-29T23:05:14.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 10 mgrc shutdown 2023-09-29T23:05:14.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 1 -- 172.21.15.115:0/1105987156 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f476c08e830 msgr2=0x7f476c090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f476c08e830 0x7f476c090ce0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4780009ab0 tx=0x7f4780018000 comp rx=0 tx=0).stop 2023-09-29T23:05:14.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 1 -- 172.21.15.115:0/1105987156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f478806c1f0 msgr2=0x7f4788141d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:14.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f478806c1f0 0x7f4788141d70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f478400ec80 tx=0x7f47840091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 1 -- 172.21.15.115:0/1105987156 shutdown_connections 2023-09-29T23:05:14.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47880a5000 0x7f47881422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f478806c1f0 0x7f4788141d70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f476c08e830 0x7f476c090ce0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 1 --2- 172.21.15.115:0/1105987156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f478806be20 0x7f4788099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:14.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 1 -- 172.21.15.115:0/1105987156 >> 172.21.15.115:0/1105987156 conn(0x7f47880b4bc0 msgr2=0x7f47880b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:14.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 1 -- 172.21.15.115:0/1105987156 shutdown_connections 2023-09-29T23:05:14.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:14.713+0000 7f47905ed700 1 -- 172.21.15.115:0/1105987156 wait complete. 2023-09-29T23:05:14.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2023-09-29T23:05:15.676 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-29T23:05:15.695 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-29T23:05:15.705 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-29T23:05:15.729 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-29T23:05:15.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c314e7700 1 Processor -- start 2023-09-29T23:05:15.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c314e7700 1 -- start start 2023-09-29T23:05:15.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c314e7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2c2c068ce0 0x7f2c2c09fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c314e7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c2c0a1690 0x7f2c2c13ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c314e7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2c0690b0 con 0x7f2c2c0a1a60 2023-09-29T23:05:15.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c314e7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2c0a0530 con 0x7f2c2c068ce0 2023-09-29T23:05:15.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c314e7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0b68a0 con 0x7f2c2c0a1690 2023-09-29T23:05:15.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c30ce6700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2c2c0a1a60 0x7f2c2c0b40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34832/0 (socket says 172.21.15.115:34832) 2023-09-29T23:05:15.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c2b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c2c0a1690 0x7f2c2c13ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c30ce6700 1 -- 172.21.15.115:0/25902622 learned_addr learned my addr 172.21.15.115:0/25902622 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:15.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c2bfff700 1 --2- 172.21.15.115:0/25902622 >> v2:172.21.15.156:3300/0 conn(0x7f2c2c068ce0 0x7f2c2c09fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c2b7fe700 1 -- 172.21.15.115:0/25902622 >> v2:172.21.15.156:3300/0 conn(0x7f2c2c068ce0 msgr2=0x7f2c2c09fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:15.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c2b7fe700 1 --2- 172.21.15.115:0/25902622 >> v2:172.21.15.156:3300/0 conn(0x7f2c2c068ce0 0x7f2c2c09fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c2b7fe700 1 -- 172.21.15.115:0/25902622 >> v1:172.21.15.115:6789/0 conn(0x7f2c2c0a1a60 legacy=0x7f2c2c0b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c2affd700 1 -- 172.21.15.115:0/25902622 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476679244 0 0) 0x7f2c2c0690b0 con 0x7f2c2c0a1a60 2023-09-29T23:05:15.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.801+0000 7f2c2b7fe700 1 -- 172.21.15.115:0/25902622 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c0b6b60 con 0x7f2c2c0a1690 2023-09-29T23:05:15.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c2bfff700 1 --2- 172.21.15.115:0/25902622 >> v2:172.21.15.156:3300/0 conn(0x7f2c2c068ce0 0x7f2c2c09fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:15.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c2b7fe700 1 --2- 172.21.15.115:0/25902622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c2c0a1690 0x7f2c2c13ef70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0b6d50 tx=0x7f2c200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9269bc35ede26b56 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:15.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c2affd700 1 -- 172.21.15.115:0/25902622 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000b740 con 0x7f2c2c0a1690 2023-09-29T23:05:15.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c2affd700 1 -- 172.21.15.115:0/25902622 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2000b8a0 con 0x7f2c2c0a1690 2023-09-29T23:05:15.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c2affd700 1 -- 172.21.15.115:0/25902622 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000bc60 con 0x7f2c2c0a1690 2023-09-29T23:05:15.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c314e7700 1 -- 172.21.15.115:0/25902622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c2c0a1690 msgr2=0x7f2c2c13ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c314e7700 1 --2- 172.21.15.115:0/25902622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c2c0a1690 0x7f2c2c13ef70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0b6d50 tx=0x7f2c200091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c314e7700 1 -- 172.21.15.115:0/25902622 shutdown_connections 2023-09-29T23:05:15.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c314e7700 1 --2- 172.21.15.115:0/25902622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c2c0a1690 0x7f2c2c13ef70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c314e7700 1 --2- 172.21.15.115:0/25902622 >> v2:172.21.15.156:3300/0 conn(0x7f2c2c068ce0 0x7f2c2c09fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c314e7700 1 -- 172.21.15.115:0/25902622 >> 172.21.15.115:0/25902622 conn(0x7f2c2c069520 msgr2=0x7f2c2c0683a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:15.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c314e7700 1 -- 172.21.15.115:0/25902622 shutdown_connections 2023-09-29T23:05:15.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c314e7700 1 -- 172.21.15.115:0/25902622 wait complete. 2023-09-29T23:05:15.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c314e7700 1 Processor -- start 2023-09-29T23:05:15.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.805+0000 7f2c314e7700 1 -- start start 2023-09-29T23:05:15.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c314e7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c2c068ce0 0x7f2c2c13f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c314e7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c0a1690 0x7f2c2c13be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c314e7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c2c0a1a60 0x7f2c2c0ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c314e7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0accd0 con 0x7f2c2c0a1a60 2023-09-29T23:05:15.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c314e7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c152dd0 con 0x7f2c2c0a1690 2023-09-29T23:05:15.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c314e7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c153090 con 0x7f2c2c068ce0 2023-09-29T23:05:15.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c30ce6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c2c0a1a60 0x7f2c2c0ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c2bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c2c068ce0 0x7f2c2c13f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c30ce6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c2c0a1a60 0x7f2c2c0ad4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37440/0 (socket says 172.21.15.115:37440) 2023-09-29T23:05:15.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c30ce6700 1 -- 172.21.15.115:0/3142910278 learned_addr learned my addr 172.21.15.115:0/3142910278 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:15.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a94faa700 1 Processor -- start 2023-09-29T23:05:15.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a94faa700 1 -- start start 2023-09-29T23:05:15.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c2b7fe700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c0a1690 0x7f2c2c13be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c2bfff700 1 -- 172.21.15.115:0/3142910278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c0a1690 msgr2=0x7f2c2c13be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c2bfff700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c0a1690 0x7f2c2c13be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c2bfff700 1 -- 172.21.15.115:0/3142910278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c2c0a1a60 msgr2=0x7f2c2c0ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c2bfff700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c2c0a1a60 0x7f2c2c0ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c2bfff700 1 -- 172.21.15.115:0/3142910278 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20009420 con 0x7f2c2c068ce0 2023-09-29T23:05:15.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c30ce6700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c2c0a1a60 0x7f2c2c0ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:15.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c2b7fe700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c0a1690 0x7f2c2c13be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:15.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c2bfff700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c2c068ce0 0x7f2c2c13f950 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c006fd0 tx=0x7f2c1c008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:15.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c13fff700 1 -- 172.21.15.115:0/3142910278 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c013410 con 0x7f2c2c068ce0 2023-09-29T23:05:15.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c13fff700 1 -- 172.21.15.115:0/3142910278 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c013570 con 0x7f2c2c068ce0 2023-09-29T23:05:15.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c314e7700 1 -- 172.21.15.115:0/3142910278 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c152a40 con 0x7f2c2c068ce0 2023-09-29T23:05:15.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a94faa700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3a90143590 0x7f3a90143990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a94faa700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3a900b16a0 0x7f3a900b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c13fff700 1 -- 172.21.15.115:0/3142910278 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c0138f0 con 0x7f2c2c068ce0 2023-09-29T23:05:15.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a94faa700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a900686b0 con 0x7f3a900682e0 2023-09-29T23:05:15.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a94faa700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a900b2000 con 0x7f3a90143590 2023-09-29T23:05:15.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a94faa700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a90143040 con 0x7f3a900b16a0 2023-09-29T23:05:15.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a8f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3a900682e0 0x7f3a9009aad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34848/0 (socket says 172.21.15.115:34848) 2023-09-29T23:05:15.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a8f7fe700 1 -- 172.21.15.115:0/1865063338 learned_addr learned my addr 172.21.15.115:0/1865063338 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:15.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a8ffff700 1 --2- 172.21.15.115:0/1865063338 >> v2:172.21.15.156:3300/0 conn(0x7f3a900b16a0 0x7f3a900b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c314e7700 1 -- 172.21.15.115:0/3142910278 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2c0a9db0 con 0x7f2c2c068ce0 2023-09-29T23:05:15.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a8e7fc700 1 -- 172.21.15.115:0/1865063338 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129808634 0 0) 0x7f3a900686b0 con 0x7f3a900682e0 2023-09-29T23:05:15.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a8e7fc700 1 -- 172.21.15.115:0/1865063338 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a7c003570 con 0x7f3a900682e0 2023-09-29T23:05:15.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a8ffff700 1 -- 172.21.15.115:0/1865063338 >> v2:172.21.15.115:3300/0 conn(0x7f3a90143590 msgr2=0x7f3a90143990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-29T23:05:15.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a8ffff700 1 --2- 172.21.15.115:0/1865063338 >> v2:172.21.15.115:3300/0 conn(0x7f3a90143590 0x7f3a90143990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a8ffff700 1 -- 172.21.15.115:0/1865063338 >> v1:172.21.15.115:6789/0 conn(0x7f3a900682e0 legacy=0x7f3a9009aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a8ffff700 1 -- 172.21.15.115:0/1865063338 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a90143300 con 0x7f3a900b16a0 2023-09-29T23:05:15.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a8ffff700 1 --2- 172.21.15.115:0/1865063338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a900b16a0 0x7f3a900b1ac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a900a1dc0 tx=0x7f3a800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73528bcf1369155f server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:15.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c314e7700 1 -- 172.21.15.115:0/3142910278 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2c04be00 con 0x7f2c2c068ce0 2023-09-29T23:05:15.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a8e7fc700 1 -- 172.21.15.115:0/1865063338 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8000b690 con 0x7f3a900b16a0 2023-09-29T23:05:15.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a8e7fc700 1 -- 172.21.15.115:0/1865063338 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8000b810 con 0x7f3a900b16a0 2023-09-29T23:05:15.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f3a8e7fc700 1 -- 172.21.15.115:0/1865063338 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8000bb90 con 0x7f3a900b16a0 2023-09-29T23:05:15.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c13fff700 1 -- 172.21.15.115:0/3142910278 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f2c1c013ce0 con 0x7f2c2c068ce0 2023-09-29T23:05:15.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.809+0000 7f2c13fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:15.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f2c13fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:15.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f2c13fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:15.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f2c13fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:15.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f2c13fff700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2c1808e8b0 0x7f2c18090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f2c13fff700 1 -- 172.21.15.115:0/3142910278 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f2c1c0b43e0 con 0x7f2c2c068ce0 2023-09-29T23:05:15.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f2c2b7fe700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2c1808e8b0 0x7f2c18090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 -- 172.21.15.115:0/1865063338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a900b16a0 msgr2=0x7f3a900b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 --2- 172.21.15.115:0/1865063338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a900b16a0 0x7f3a900b1ac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a900a1dc0 tx=0x7f3a800091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 -- 172.21.15.115:0/1865063338 shutdown_connections 2023-09-29T23:05:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 --2- 172.21.15.115:0/1865063338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a900b16a0 0x7f3a900b1ac0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 --2- 172.21.15.115:0/1865063338 >> v2:172.21.15.115:3300/0 conn(0x7f3a90143590 0x7f3a90143990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 -- 172.21.15.115:0/1865063338 >> 172.21.15.115:0/1865063338 conn(0x7f3a900692c0 msgr2=0x7f3a900696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 -- 172.21.15.115:0/1865063338 shutdown_connections 2023-09-29T23:05:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 -- 172.21.15.115:0/1865063338 wait complete. 2023-09-29T23:05:15.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f2c2b7fe700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2c1808e8b0 0x7f2c18090d60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c200091e0 tx=0x7f2c20016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:15.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 Processor -- start 2023-09-29T23:05:15.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 -- start start 2023-09-29T23:05:15.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a900682e0 0x7f3a9006ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a900b16a0 0x7f3a9009d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a90143590 0x7f3a90152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9009e2c0 con 0x7f3a900b16a0 2023-09-29T23:05:15.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9009e580 con 0x7f3a90143590 2023-09-29T23:05:15.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a94faa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9006d7a0 con 0x7f3a900682e0 2023-09-29T23:05:15.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a8effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a900b16a0 0x7f3a9009d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a8effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a900b16a0 0x7f3a9009d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37448/0 (socket says 172.21.15.115:37448) 2023-09-29T23:05:15.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a8f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a900682e0 0x7f3a9006ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a8effd700 1 -- 172.21.15.115:0/3962450179 learned_addr learned my addr 172.21.15.115:0/3962450179 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a8ffff700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a90143590 0x7f3a90152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a8f7fe700 1 -- 172.21.15.115:0/3962450179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a90143590 msgr2=0x7f3a90152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a8f7fe700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a90143590 0x7f3a90152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a8f7fe700 1 -- 172.21.15.115:0/3962450179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a900b16a0 msgr2=0x7f3a9009d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a8f7fe700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a900b16a0 0x7f3a9009d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a8f7fe700 1 -- 172.21.15.115:0/3962450179 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a80009420 con 0x7f3a900682e0 2023-09-29T23:05:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.813+0000 7f3a8effd700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a900b16a0 0x7f3a9009d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.817+0000 7f3a8f7fe700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a900682e0 0x7f3a9006ce00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800cc40 tx=0x7f3a88001a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:15.824 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.817+0000 7f3a877fe700 1 -- 172.21.15.115:0/3962450179 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8800a850 con 0x7f3a900682e0 2023-09-29T23:05:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.817+0000 7f3a877fe700 1 -- 172.21.15.115:0/3962450179 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8800a9d0 con 0x7f3a900682e0 2023-09-29T23:05:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.817+0000 7f3a94faa700 1 -- 172.21.15.115:0/3962450179 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9006c5e0 con 0x7f3a900682e0 2023-09-29T23:05:15.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.817+0000 7f2c13fff700 1 -- 172.21.15.115:0/3142910278 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2c1c084ea0 con 0x7f2c2c068ce0 2023-09-29T23:05:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.821+0000 7f3a877fe700 1 -- 172.21.15.115:0/3962450179 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8800ad90 con 0x7f3a900682e0 2023-09-29T23:05:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.821+0000 7f3a94faa700 1 -- 172.21.15.115:0/3962450179 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9006ee30 con 0x7f3a900682e0 2023-09-29T23:05:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.821+0000 7f3a94faa700 1 -- 172.21.15.115:0/3962450179 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a9004be00 con 0x7f3a900682e0 2023-09-29T23:05:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.821+0000 7f3a877fe700 1 -- 172.21.15.115:0/3962450179 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f3a88007300 con 0x7f3a900682e0 2023-09-29T23:05:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.821+0000 7f3a877fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:15.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.821+0000 7f3a877fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.821+0000 7f3a877fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.821+0000 7f3a877fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.821+0000 7f3a877fe700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3a7008e830 0x7f3a70090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.825+0000 7f3a877fe700 1 -- 172.21.15.115:0/3962450179 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f3a880b4b20 con 0x7f3a900682e0 2023-09-29T23:05:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.825+0000 7f3a8effd700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3a7008e830 0x7f3a70090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.825+0000 7f3a8effd700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3a7008e830 0x7f3a70090ce0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3a900a1750 tx=0x7f3a780090f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:15.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.829+0000 7f3a877fe700 1 -- 172.21.15.115:0/3962450179 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3a880854b0 con 0x7f3a900682e0 2023-09-29T23:05:15.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.837+0000 7efeaa372700 1 Processor -- start 2023-09-29T23:05:15.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.837+0000 7efeaa372700 1 -- start start 2023-09-29T23:05:15.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efeaa372700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efea40680b0 0x7efea413c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efeaa372700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efea4068480 0x7efea409e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efeaa372700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea409ed70 con 0x7efea413d050 2023-09-29T23:05:15.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efeaa372700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea4140150 con 0x7efea40680b0 2023-09-29T23:05:15.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efeaa372700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea4140410 con 0x7efea4068480 2023-09-29T23:05:15.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efea890f700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efea413d050 0x7efea409aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34856/0 (socket says 172.21.15.115:34856) 2023-09-29T23:05:15.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efea3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efea40680b0 0x7efea413c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efea890f700 1 -- 172.21.15.115:0/4248617923 learned_addr learned my addr 172.21.15.115:0/4248617923 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:15.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efea37fe700 1 --2- 172.21.15.115:0/4248617923 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efea4068480 0x7efea409e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efea3fff700 1 -- 172.21.15.115:0/4248617923 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efea4068480 msgr2=0x7efea409e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:15.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efea3fff700 1 --2- 172.21.15.115:0/4248617923 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efea4068480 0x7efea409e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efea3fff700 1 -- 172.21.15.115:0/4248617923 >> v1:172.21.15.115:6789/0 conn(0x7efea413d050 legacy=0x7efea409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efea3fff700 1 -- 172.21.15.115:0/4248617923 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea413fd80 con 0x7efea40680b0 2023-09-29T23:05:15.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efea3fff700 1 --2- 172.21.15.115:0/4248617923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40680b0 0x7efea413c800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009e60 tx=0x7efe9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3a95dac1a133a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:15.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efea2ffd700 1 -- 172.21.15.115:0/4248617923 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00bb60 con 0x7efea40680b0 2023-09-29T23:05:15.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efea2ffd700 1 -- 172.21.15.115:0/4248617923 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c00bcc0 con 0x7efea40680b0 2023-09-29T23:05:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efea2ffd700 1 -- 172.21.15.115:0/4248617923 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0116b0 con 0x7efea40680b0 2023-09-29T23:05:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efeaa372700 1 -- 172.21.15.115:0/4248617923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40680b0 msgr2=0x7efea413c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efeaa372700 1 --2- 172.21.15.115:0/4248617923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40680b0 0x7efea413c800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009e60 tx=0x7efe9c009780 comp rx=0 tx=0).stop 2023-09-29T23:05:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efeaa372700 1 -- 172.21.15.115:0/4248617923 shutdown_connections 2023-09-29T23:05:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efeaa372700 1 --2- 172.21.15.115:0/4248617923 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efea4068480 0x7efea409e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efeaa372700 1 --2- 172.21.15.115:0/4248617923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40680b0 0x7efea413c800 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.841+0000 7efeaa372700 1 -- 172.21.15.115:0/4248617923 >> 172.21.15.115:0/4248617923 conn(0x7efea40b1ef0 msgr2=0x7efea40b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efeaa372700 1 -- 172.21.15.115:0/4248617923 shutdown_connections 2023-09-29T23:05:15.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efeaa372700 1 -- 172.21.15.115:0/4248617923 wait complete. 2023-09-29T23:05:15.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efeaa372700 1 Processor -- start 2023-09-29T23:05:15.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efeaa372700 1 -- start start 2023-09-29T23:05:15.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efeaa372700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40680b0 0x7efea413a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efeaa372700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efea4068480 0x7efea413ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efeaa372700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efea413d050 0x7efea406eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efeaa372700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea41391c0 con 0x7efea40680b0 2023-09-29T23:05:15.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efeaa372700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea4139480 con 0x7efea413d050 2023-09-29T23:05:15.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efeaa372700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea4139740 con 0x7efea4068480 2023-09-29T23:05:15.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efea3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40680b0 0x7efea413a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efea37fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efea4068480 0x7efea413ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efea3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40680b0 0x7efea413a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37466/0 (socket says 172.21.15.115:37466) 2023-09-29T23:05:15.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efea37fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efea4068480 0x7efea413ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:57544/0 (socket says 172.21.15.115:57544) 2023-09-29T23:05:15.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efea3fff700 1 -- 172.21.15.115:0/1078729824 learned_addr learned my addr 172.21.15.115:0/1078729824 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:15.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efea890f700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efea413d050 0x7efea406eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efea37fe700 1 -- 172.21.15.115:0/1078729824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efea413d050 msgr2=0x7efea406eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efea37fe700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efea413d050 0x7efea406eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efea37fe700 1 -- 172.21.15.115:0/1078729824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40680b0 msgr2=0x7efea413a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efea37fe700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40680b0 0x7efea413a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efea37fe700 1 -- 172.21.15.115:0/1078729824 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c009a20 con 0x7efea4068480 2023-09-29T23:05:15.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efea890f700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efea413d050 0x7efea406eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:05:15.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efea37fe700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efea4068480 0x7efea413ec50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe9400ea20 tx=0x7efe940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:15.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efe9bfff700 1 -- 172.21.15.115:0/1078729824 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400c7f0 con 0x7efea4068480 2023-09-29T23:05:15.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efe9bfff700 1 -- 172.21.15.115:0/1078729824 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9400c950 con 0x7efea4068480 2023-09-29T23:05:15.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efeaa372700 1 -- 172.21.15.115:0/1078729824 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea413f190 con 0x7efea4068480 2023-09-29T23:05:15.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efe9bfff700 1 -- 172.21.15.115:0/1078729824 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400ccf0 con 0x7efea4068480 2023-09-29T23:05:15.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.845+0000 7efeaa372700 1 -- 172.21.15.115:0/1078729824 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea406f580 con 0x7efea4068480 2023-09-29T23:05:15.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7efeaa372700 1 -- 172.21.15.115:0/1078729824 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea4070990 con 0x7efea4068480 2023-09-29T23:05:15.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7efe9bfff700 1 -- 172.21.15.115:0/1078729824 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7efe94013680 con 0x7efea4068480 2023-09-29T23:05:15.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7efe9bfff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:15.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7efe9bfff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:15.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7efe9bfff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:15.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7efe9bfff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:15.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7efe9bfff700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efe8408e8b0 0x7efe84090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7efe9bfff700 1 -- 172.21.15.115:0/1078729824 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7efe940b49b0 con 0x7efea4068480 2023-09-29T23:05:15.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7f49d759e700 1 Processor -- start 2023-09-29T23:05:15.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7f49d759e700 1 -- start start 2023-09-29T23:05:15.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7efea3fff700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efe8408e8b0 0x7efe84090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7efea3fff700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efe8408e8b0 0x7efe84090d60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0099f0 tx=0x7efe9c01b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7f49d759e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49d80682e0 0x7f49d809f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7f49d759e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f49d80b1a10 0x7f49d80afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7f49d759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49d80b1e10 0x7f49d80b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7f49d759e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d809f890 con 0x7f49d80682e0 2023-09-29T23:05:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7f49d759e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d80686b0 con 0x7f49d80b1a10 2023-09-29T23:05:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.849+0000 7f49d759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80a0100 con 0x7f49d80b1e10 2023-09-29T23:05:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49d80682e0 0x7f49d809f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f49d80682e0 0x7f49d809f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37468/0 (socket says 172.21.15.115:37468) 2023-09-29T23:05:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d6d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49d80b1e10 0x7f49d80b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d659c700 1 -- 172.21.15.115:0/1363753484 learned_addr learned my addr 172.21.15.115:0/1363753484 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:15.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49cffff700 1 --2- 172.21.15.115:0/1363753484 >> v2:172.21.15.156:3300/0 conn(0x7f49d80b1a10 0x7f49d80afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d659c700 1 -- 172.21.15.115:0/1363753484 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49d80b1e10 msgr2=0x7f49d80b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:15.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d659c700 1 --2- 172.21.15.115:0/1363753484 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49d80b1e10 0x7f49d80b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d659c700 1 -- 172.21.15.115:0/1363753484 >> v2:172.21.15.156:3300/0 conn(0x7f49d80b1a10 msgr2=0x7f49d80afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:15.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d659c700 1 --2- 172.21.15.115:0/1363753484 >> v2:172.21.15.156:3300/0 conn(0x7f49d80b1a10 0x7f49d80afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d659c700 1 -- 172.21.15.115:0/1363753484 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d80a03a0 con 0x7f49d80682e0 2023-09-29T23:05:15.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49cffff700 1 --2- 172.21.15.115:0/1363753484 >> v2:172.21.15.156:3300/0 conn(0x7f49d80b1a10 0x7f49d80afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:15.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d6d9d700 1 --2- 172.21.15.115:0/1363753484 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49d80b1e10 0x7f49d80b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:15.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d659c700 1 --2- 172.21.15.115:0/1363753484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49d80682e0 0x7f49d809f350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49d809e140 tx=0x7f49c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff48ee911d2d428e server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:15.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d5d9b700 1 -- 172.21.15.115:0/1363753484 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c0009e70 con 0x7f49d80682e0 2023-09-29T23:05:15.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d5d9b700 1 -- 172.21.15.115:0/1363753484 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c000b860 con 0x7f49d80682e0 2023-09-29T23:05:15.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d5d9b700 1 -- 172.21.15.115:0/1363753484 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c000bc00 con 0x7f49d80682e0 2023-09-29T23:05:15.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d759e700 1 -- 172.21.15.115:0/1363753484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49d80682e0 msgr2=0x7f49d809f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d759e700 1 --2- 172.21.15.115:0/1363753484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49d80682e0 0x7f49d809f350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49d809e140 tx=0x7f49c0009250 comp rx=0 tx=0).stop 2023-09-29T23:05:15.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d759e700 1 -- 172.21.15.115:0/1363753484 shutdown_connections 2023-09-29T23:05:15.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d759e700 1 --2- 172.21.15.115:0/1363753484 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49d80b1e10 0x7f49d80b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d759e700 1 --2- 172.21.15.115:0/1363753484 >> v2:172.21.15.156:3300/0 conn(0x7f49d80b1a10 0x7f49d80afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d759e700 1 --2- 172.21.15.115:0/1363753484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49d80682e0 0x7f49d809f350 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d759e700 1 -- 172.21.15.115:0/1363753484 >> 172.21.15.115:0/1363753484 conn(0x7f49d80692c0 msgr2=0x7f49d80696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:15.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d759e700 1 -- 172.21.15.115:0/1363753484 shutdown_connections 2023-09-29T23:05:15.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d759e700 1 -- 172.21.15.115:0/1363753484 wait complete. 2023-09-29T23:05:15.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d759e700 1 Processor -- start 2023-09-29T23:05:15.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.853+0000 7f49d759e700 1 -- start start 2023-09-29T23:05:15.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49d80682e0 0x7f49d813c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d759e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d80b1a10 0x7f49d8095930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49d80b1e10 0x7f49d813afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d759e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d813d320 con 0x7f49d80b1e10 2023-09-29T23:05:15.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d759e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80951c0 con 0x7f49d80b1a10 2023-09-29T23:05:15.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8096290 con 0x7f49d80682e0 2023-09-29T23:05:15.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49d80682e0 0x7f49d813c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d6d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49d80b1e10 0x7f49d813afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49d80682e0 0x7f49d813c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:57564/0 (socket says 172.21.15.115:57564) 2023-09-29T23:05:15.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d659c700 1 -- 172.21.15.115:0/346192505 learned_addr learned my addr 172.21.15.115:0/346192505 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:15.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49cffff700 1 --2- 172.21.15.115:0/346192505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d80b1a10 0x7f49d8095930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d659c700 1 -- 172.21.15.115:0/346192505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d80b1a10 msgr2=0x7f49d8095930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d659c700 1 --2- 172.21.15.115:0/346192505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d80b1a10 0x7f49d8095930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d659c700 1 -- 172.21.15.115:0/346192505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49d80b1e10 msgr2=0x7f49d813afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d659c700 1 --2- 172.21.15.115:0/346192505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49d80b1e10 0x7f49d813afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d659c700 1 -- 172.21.15.115:0/346192505 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d0009a20 con 0x7f49d80682e0 2023-09-29T23:05:15.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d659c700 1 --2- 172.21.15.115:0/346192505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49d80682e0 0x7f49d813c950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f49c00090b0 tx=0x7f49c0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:15.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49ce7fc700 1 -- 172.21.15.115:0/346192505 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c0000d10 con 0x7f49d80682e0 2023-09-29T23:05:15.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49ce7fc700 1 -- 172.21.15.115:0/346192505 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c001f070 con 0x7f49d80682e0 2023-09-29T23:05:15.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d759e700 1 -- 172.21.15.115:0/346192505 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c00094f0 con 0x7f49d80682e0 2023-09-29T23:05:15.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7efe9bfff700 1 -- 172.21.15.115:0/1078729824 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efe94085470 con 0x7efea4068480 2023-09-29T23:05:15.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49ce7fc700 1 -- 172.21.15.115:0/346192505 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c00266d0 con 0x7f49d80682e0 2023-09-29T23:05:15.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.857+0000 7f49d759e700 1 -- 172.21.15.115:0/346192505 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d8142800 con 0x7f49d80682e0 2023-09-29T23:05:15.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.861+0000 7f49d759e700 1 -- 172.21.15.115:0/346192505 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49bc0050b0 con 0x7f49d80682e0 2023-09-29T23:05:15.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.861+0000 7f49ce7fc700 1 -- 172.21.15.115:0/346192505 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f49c0026a40 con 0x7f49d80682e0 2023-09-29T23:05:15.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.861+0000 7f49ce7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:15.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.861+0000 7f49ce7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:15.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.861+0000 7f49ce7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:15.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.861+0000 7f49ce7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:15.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.861+0000 7f49ce7fc700 1 --2- 172.21.15.115:0/346192505 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f49c408eae0 0x7f49c4090f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:15.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.861+0000 7f49ce7fc700 1 -- 172.21.15.115:0/346192505 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f49c0021070 con 0x7f49d80682e0 2023-09-29T23:05:15.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.861+0000 7f49cffff700 1 --2- 172.21.15.115:0/346192505 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f49c408eae0 0x7f49c4090f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:15.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.861+0000 7f49cffff700 1 --2- 172.21.15.115:0/346192505 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f49c408eae0 0x7f49c4090f90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f49d80a4010 tx=0x7f49c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:15.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.869+0000 7f49ce7fc700 1 -- 172.21.15.115:0/346192505 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f49c00872e0 con 0x7f49d80682e0 2023-09-29T23:05:15.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.989+0000 7f2c314e7700 1 -- 172.21.15.115:0/3142910278 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2c2c0a1f60 con 0x7f2c2c068ce0 2023-09-29T23:05:15.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.989+0000 7f2c13fff700 1 -- 172.21.15.115:0/3142910278 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2c1c0884c0 con 0x7f2c2c068ce0 2023-09-29T23:05:15.991 INFO:teuthology.orchestra.run.smithi115.stdout:38654705670 2023-09-29T23:05:15.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.989+0000 7f2c314e7700 10 mgrc shutdown 2023-09-29T23:05:15.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.989+0000 7f2c314e7700 1 -- 172.21.15.115:0/3142910278 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2c1808e8b0 msgr2=0x7f2c18090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.989+0000 7f2c314e7700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2c1808e8b0 0x7f2c18090d60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c200091e0 tx=0x7f2c20016000 comp rx=0 tx=0).stop 2023-09-29T23:05:15.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.989+0000 7f2c314e7700 1 -- 172.21.15.115:0/3142910278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c2c068ce0 msgr2=0x7f2c2c13f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:15.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.989+0000 7f2c314e7700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c2c068ce0 0x7f2c2c13f950 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c006fd0 tx=0x7f2c1c008040 comp rx=0 tx=0).stop 2023-09-29T23:05:15.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.993+0000 7f2c314e7700 1 -- 172.21.15.115:0/3142910278 shutdown_connections 2023-09-29T23:05:15.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.993+0000 7f2c314e7700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2c1808e8b0 0x7f2c18090d60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.993+0000 7f2c314e7700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c2c0a1a60 0x7f2c2c0ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.993+0000 7f2c314e7700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c0a1690 0x7f2c2c13be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.993+0000 7f2c314e7700 1 --2- 172.21.15.115:0/3142910278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2c2c068ce0 0x7f2c2c13f950 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:15.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.993+0000 7f2c314e7700 1 -- 172.21.15.115:0/3142910278 >> 172.21.15.115:0/3142910278 conn(0x7f2c2c069520 msgr2=0x7f2c2c0b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:15.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.993+0000 7f2c314e7700 1 -- 172.21.15.115:0/3142910278 shutdown_connections 2023-09-29T23:05:15.994 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:15.993+0000 7f2c314e7700 1 -- 172.21.15.115:0/3142910278 wait complete. 2023-09-29T23:05:16.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a94faa700 1 -- 172.21.15.115:0/3962450179 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a9006d8e0 con 0x7f3a900682e0 2023-09-29T23:05:16.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a877fe700 1 -- 172.21.15.115:0/3962450179 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a9006d8e0 con 0x7f3a900682e0 2023-09-29T23:05:16.003 INFO:teuthology.orchestra.run.smithi115.stdout:38654705670 2023-09-29T23:05:16.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705670 for osd.0 2023-09-29T23:05:16.004 DEBUG:teuthology.parallel:result is None 2023-09-29T23:05:16.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a94faa700 10 mgrc shutdown 2023-09-29T23:05:16.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a94faa700 1 -- 172.21.15.115:0/3962450179 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3a7008e830 msgr2=0x7f3a70090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a94faa700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3a7008e830 0x7f3a70090ce0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3a900a1750 tx=0x7f3a780090f0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a94faa700 1 -- 172.21.15.115:0/3962450179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a900682e0 msgr2=0x7f3a9006ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a94faa700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a900682e0 0x7f3a9006ce00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800cc40 tx=0x7f3a88001a20 comp rx=0 tx=0).stop 2023-09-29T23:05:16.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a94faa700 1 -- 172.21.15.115:0/3962450179 shutdown_connections 2023-09-29T23:05:16.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a94faa700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a90143590 0x7f3a90152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a94faa700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3a7008e830 0x7f3a70090ce0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a94faa700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a900b16a0 0x7f3a9009d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a94faa700 1 --2- 172.21.15.115:0/3962450179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a900682e0 0x7f3a9006ce00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a94faa700 1 -- 172.21.15.115:0/3962450179 >> 172.21.15.115:0/3962450179 conn(0x7f3a900692c0 msgr2=0x7f3a90141ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:16.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.001+0000 7f3a94faa700 1 -- 172.21.15.115:0/3962450179 shutdown_connections 2023-09-29T23:05:16.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.005+0000 7f3a94faa700 1 -- 172.21.15.115:0/3962450179 wait complete. 2023-09-29T23:05:16.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705670 for osd.2 2023-09-29T23:05:16.017 DEBUG:teuthology.parallel:result is None 2023-09-29T23:05:16.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.017+0000 7efeaa372700 1 -- 172.21.15.115:0/1078729824 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efea413d4d0 con 0x7efea4068480 2023-09-29T23:05:16.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.017+0000 7efe9bfff700 1 -- 172.21.15.115:0/1078729824 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe94021090 con 0x7efea4068480 2023-09-29T23:05:16.020 INFO:teuthology.orchestra.run.smithi115.stdout:38654705670 2023-09-29T23:05:16.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.021+0000 7efeaa372700 10 mgrc shutdown 2023-09-29T23:05:16.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.021+0000 7efeaa372700 1 -- 172.21.15.115:0/1078729824 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efe8408e8b0 msgr2=0x7efe84090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.021+0000 7efeaa372700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efe8408e8b0 0x7efe84090d60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0099f0 tx=0x7efe9c01b000 comp rx=0 tx=0).stop 2023-09-29T23:05:16.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.021+0000 7efeaa372700 1 -- 172.21.15.115:0/1078729824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efea4068480 msgr2=0x7efea413ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.021+0000 7efeaa372700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efea4068480 0x7efea413ec50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe9400ea20 tx=0x7efe940091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.021+0000 7efeaa372700 1 -- 172.21.15.115:0/1078729824 shutdown_connections 2023-09-29T23:05:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.021+0000 7efeaa372700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efea413d050 0x7efea406eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.021+0000 7efeaa372700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efea4068480 0x7efea413ec50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.021+0000 7efeaa372700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efe8408e8b0 0x7efe84090d60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.021+0000 7efeaa372700 1 --2- 172.21.15.115:0/1078729824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efea40680b0 0x7efea413a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.021+0000 7efeaa372700 1 -- 172.21.15.115:0/1078729824 >> 172.21.15.115:0/1078729824 conn(0x7efea40b1ef0 msgr2=0x7efea409cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.021+0000 7efeaa372700 1 -- 172.21.15.115:0/1078729824 shutdown_connections 2023-09-29T23:05:16.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.021+0000 7efeaa372700 1 -- 172.21.15.115:0/1078729824 wait complete. 2023-09-29T23:05:16.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.033+0000 7f49d759e700 1 -- 172.21.15.115:0/346192505 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f49bc005630 con 0x7f49d80682e0 2023-09-29T23:05:16.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.033+0000 7f49ce7fc700 1 -- 172.21.15.115:0/346192505 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49c0015090 con 0x7f49d80682e0 2023-09-29T23:05:16.035 INFO:teuthology.orchestra.run.smithi115.stdout:38654705670 2023-09-29T23:05:16.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705670 for osd.3 2023-09-29T23:05:16.038 DEBUG:teuthology.parallel:result is None 2023-09-29T23:05:16.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.037+0000 7f49d759e700 10 mgrc shutdown 2023-09-29T23:05:16.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.037+0000 7f49d759e700 1 -- 172.21.15.115:0/346192505 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f49c408eae0 msgr2=0x7f49c4090f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.037+0000 7f49d759e700 1 --2- 172.21.15.115:0/346192505 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f49c408eae0 0x7f49c4090f90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f49d80a4010 tx=0x7f49c8008040 comp rx=0 tx=0).stop 2023-09-29T23:05:16.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.037+0000 7f49d759e700 1 -- 172.21.15.115:0/346192505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49d80682e0 msgr2=0x7f49d813c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.037+0000 7f49d759e700 1 --2- 172.21.15.115:0/346192505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49d80682e0 0x7f49d813c950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f49c00090b0 tx=0x7f49c0017000 comp rx=0 tx=0).stop 2023-09-29T23:05:16.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.037+0000 7f49d759e700 1 -- 172.21.15.115:0/346192505 shutdown_connections 2023-09-29T23:05:16.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.037+0000 7f49d759e700 1 --2- 172.21.15.115:0/346192505 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f49c408eae0 0x7f49c4090f90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.037+0000 7f49d759e700 1 --2- 172.21.15.115:0/346192505 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49d80b1e10 0x7f49d813afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.037+0000 7f49d759e700 1 --2- 172.21.15.115:0/346192505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49d80b1a10 0x7f49d8095930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.037+0000 7f49d759e700 1 --2- 172.21.15.115:0/346192505 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f49d80682e0 0x7f49d813c950 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.037+0000 7f49d759e700 1 -- 172.21.15.115:0/346192505 >> 172.21.15.115:0/346192505 conn(0x7f49d80692c0 msgr2=0x7f49d80a2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:16.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.037+0000 7f49d759e700 1 -- 172.21.15.115:0/346192505 shutdown_connections 2023-09-29T23:05:16.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.037+0000 7f49d759e700 1 -- 172.21.15.115:0/346192505 wait complete. 2023-09-29T23:05:16.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705670 for osd.1 2023-09-29T23:05:16.048 DEBUG:teuthology.parallel:result is None 2023-09-29T23:05:16.048 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-29T23:05:16.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:05:16.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fc5be9700 1 Processor -- start 2023-09-29T23:05:16.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fc5be9700 1 -- start start 2023-09-29T23:05:16.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fc5be9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8fc00b3240 0x7f8fc006ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.144 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fc5be9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc013fe20 0x7f8fc006f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fc5be9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc006ef80 con 0x7f8fc009f240 2023-09-29T23:05:16.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fc5be9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc00a4900 con 0x7f8fc00b3240 2023-09-29T23:05:16.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fc5be9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00b3610 con 0x7f8fc013fe20 2023-09-29T23:05:16.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fb7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc013fe20 0x7f8fc006f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fbf7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8fc00b3240 0x7f8fc006ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fb7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc013fe20 0x7f8fc006f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:57572/0 (socket says 172.21.15.115:57572) 2023-09-29T23:05:16.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fb7fff700 1 -- 172.21.15.115:0/3679680881 learned_addr learned my addr 172.21.15.115:0/3679680881 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:16.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fbffff700 1 --1- 172.21.15.115:0/3679680881 >> v1:172.21.15.115:6789/0 conn(0x7f8fc009f240 0x7f8fc00a34d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34860/0 (socket says 172.21.15.115:34860) 2023-09-29T23:05:16.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fb7fff700 1 -- 172.21.15.115:0/3679680881 >> v2:172.21.15.115:3300/0 conn(0x7f8fc00b3240 msgr2=0x7f8fc006ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:16.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fb7fff700 1 --2- 172.21.15.115:0/3679680881 >> v2:172.21.15.115:3300/0 conn(0x7f8fc00b3240 0x7f8fc006ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fb7fff700 1 -- 172.21.15.115:0/3679680881 >> v1:172.21.15.115:6789/0 conn(0x7f8fc009f240 legacy=0x7f8fc00a34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fb7fff700 1 -- 172.21.15.115:0/3679680881 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc006e310 con 0x7f8fc013fe20 2023-09-29T23:05:16.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.141+0000 7f8fb7fff700 1 --2- 172.21.15.115:0/3679680881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc013fe20 0x7f8fc006f3d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80099b0 tx=0x7f8fa8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=505086e86c5423e server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:16.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.145+0000 7f8fbeffd700 1 -- 172.21.15.115:0/3679680881 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8009ea0 con 0x7f8fc013fe20 2023-09-29T23:05:16.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.145+0000 7f8fbeffd700 1 -- 172.21.15.115:0/3679680881 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa800b860 con 0x7f8fc013fe20 2023-09-29T23:05:16.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.145+0000 7f8fbeffd700 1 -- 172.21.15.115:0/3679680881 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800bc00 con 0x7f8fc013fe20 2023-09-29T23:05:16.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.145+0000 7f8fc5be9700 1 -- 172.21.15.115:0/3679680881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc013fe20 msgr2=0x7f8fc006f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.145+0000 7f8fc5be9700 1 --2- 172.21.15.115:0/3679680881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc013fe20 0x7f8fc006f3d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80099b0 tx=0x7f8fa8009250 comp rx=0 tx=0).stop 2023-09-29T23:05:16.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.145+0000 7f8fc5be9700 1 -- 172.21.15.115:0/3679680881 shutdown_connections 2023-09-29T23:05:16.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.145+0000 7f8fc5be9700 1 --2- 172.21.15.115:0/3679680881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc013fe20 0x7f8fc006f3d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.145+0000 7f8fc5be9700 1 --2- 172.21.15.115:0/3679680881 >> v2:172.21.15.115:3300/0 conn(0x7f8fc00b3240 0x7f8fc006ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.145+0000 7f8fc5be9700 1 -- 172.21.15.115:0/3679680881 >> 172.21.15.115:0/3679680881 conn(0x7f8fc0068a40 msgr2=0x7f8fc0068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:16.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.145+0000 7f8fc5be9700 1 -- 172.21.15.115:0/3679680881 shutdown_connections 2023-09-29T23:05:16.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.145+0000 7f8fc5be9700 1 -- 172.21.15.115:0/3679680881 wait complete. 2023-09-29T23:05:16.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.145+0000 7f8fc5be9700 1 Processor -- start 2023-09-29T23:05:16.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.145+0000 7f8fc5be9700 1 -- start start 2023-09-29T23:05:16.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fc5be9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fc009f240 0x7f8fc0094a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fc5be9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc00b3240 0x7f8fc00a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fc5be9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fc013fe20 0x7f8fc009d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fc5be9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc0094f40 con 0x7f8fc009f240 2023-09-29T23:05:16.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fc5be9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc009e4f0 con 0x7f8fc013fe20 2023-09-29T23:05:16.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fc5be9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc009e280 con 0x7f8fc00b3240 2023-09-29T23:05:16.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fbf7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fc009f240 0x7f8fc0094a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fbf7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fc009f240 0x7f8fc0094a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37478/0 (socket says 172.21.15.115:37478) 2023-09-29T23:05:16.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fb7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc00b3240 0x7f8fc00a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fbf7fe700 1 -- 172.21.15.115:0/802453372 learned_addr learned my addr 172.21.15.115:0/802453372 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:16.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fbffff700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fc013fe20 0x7f8fc009d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fbf7fe700 1 -- 172.21.15.115:0/802453372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc00b3240 msgr2=0x7f8fc00a20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fbf7fe700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc00b3240 0x7f8fc00a20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fbf7fe700 1 -- 172.21.15.115:0/802453372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fc013fe20 msgr2=0x7f8fc009d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fbf7fe700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fc013fe20 0x7f8fc009d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fbf7fe700 1 -- 172.21.15.115:0/802453372 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80094f0 con 0x7f8fc009f240 2023-09-29T23:05:16.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fbffff700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fc013fe20 0x7f8fc009d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:16.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fb7fff700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc00b3240 0x7f8fc00a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:16.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fbf7fe700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fc009f240 0x7f8fc0094a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000ecb0 tx=0x7f8fb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:16.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fb77fe700 1 -- 172.21.15.115:0/802453372 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb000c920 con 0x7f8fc009f240 2023-09-29T23:05:16.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fb77fe700 1 -- 172.21.15.115:0/802453372 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb000ca80 con 0x7f8fc009f240 2023-09-29T23:05:16.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fc5be9700 1 -- 172.21.15.115:0/802453372 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc0150d00 con 0x7f8fc009f240 2023-09-29T23:05:16.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fb77fe700 1 -- 172.21.15.115:0/802453372 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb000ce20 con 0x7f8fc009f240 2023-09-29T23:05:16.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fc5be9700 1 -- 172.21.15.115:0/802453372 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc00a2610 con 0x7f8fc009f240 2023-09-29T23:05:16.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.149+0000 7f8fc5be9700 1 -- 172.21.15.115:0/802453372 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc0070990 con 0x7f8fc009f240 2023-09-29T23:05:16.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.153+0000 7f8fb77fe700 1 -- 172.21.15.115:0/802453372 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f8fb0013680 con 0x7f8fc009f240 2023-09-29T23:05:16.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.153+0000 7f8fb77fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:16.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.153+0000 7f8fb77fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:16.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.153+0000 7f8fb77fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:16.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.153+0000 7f8fb77fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:16.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.153+0000 7f8fb77fe700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8fa008e8b0 0x7f8fa0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.153+0000 7f8fb77fe700 1 -- 172.21.15.115:0/802453372 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f8fb00b4b90 con 0x7f8fc009f240 2023-09-29T23:05:16.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.153+0000 7f8fb7fff700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8fa008e8b0 0x7f8fa0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.157+0000 7f8fb7fff700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8fa008e8b0 0x7f8fa0090d60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80099b0 tx=0x7f8fa8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:16.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.161+0000 7f8fb77fe700 1 -- 172.21.15.115:0/802453372 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8fb0085520 con 0x7f8fc009f240 2023-09-29T23:05:16.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.313+0000 7f8fc5be9700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-29T23:05:16.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.313+0000 7f8fc5be9700 1 -- 172.21.15.115:0/802453372 --> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8fc00a4a80 con 0x7f8fa008e8b0 2023-09-29T23:05:16.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.333+0000 7f8fb77fe700 1 -- 172.21.15.115:0/802453372 <== mgr.4107 v2:172.21.15.156:6824/26644 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+266310 (secure 0 0 0) 0x7f8fc00a4a80 con 0x7f8fa008e8b0 2023-09-29T23:05:16.335 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.333+0000 7f8fb77fe700 20 mgrc handle_command_reply tid 0 r 0 2023-09-29T23:05:16.339 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.337+0000 7f8fc5be9700 10 mgrc shutdown 2023-09-29T23:05:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.337+0000 7f8fc5be9700 1 -- 172.21.15.115:0/802453372 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8fa008e8b0 msgr2=0x7f8fa0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.337+0000 7f8fc5be9700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8fa008e8b0 0x7f8fa0090d60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80099b0 tx=0x7f8fa8017000 comp rx=0 tx=0).stop 2023-09-29T23:05:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.337+0000 7f8fc5be9700 1 -- 172.21.15.115:0/802453372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fc009f240 msgr2=0x7f8fc0094a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.337+0000 7f8fc5be9700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fc009f240 0x7f8fc0094a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000ecb0 tx=0x7f8fb00091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.337+0000 7f8fc5be9700 1 -- 172.21.15.115:0/802453372 shutdown_connections 2023-09-29T23:05:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.337+0000 7f8fc5be9700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8fc013fe20 0x7f8fc009d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.337+0000 7f8fc5be9700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc00b3240 0x7f8fc00a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.337+0000 7f8fc5be9700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8fa008e8b0 0x7f8fa0090d60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.337+0000 7f8fc5be9700 1 --2- 172.21.15.115:0/802453372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fc009f240 0x7f8fc0094a00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.341 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.337+0000 7f8fc5be9700 1 -- 172.21.15.115:0/802453372 >> 172.21.15.115:0/802453372 conn(0x7f8fc0068a40 msgr2=0x7f8fc006d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:16.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.337+0000 7f8fc5be9700 1 -- 172.21.15.115:0/802453372 shutdown_connections 2023-09-29T23:05:16.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.337+0000 7f8fc5be9700 1 -- 172.21.15.115:0/802453372 wait complete. 2023-09-29T23:05:16.342 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-09-29T23:05:16.355 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-09-29T23:05:14.841795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":374797520,"kb_used":3186220,"kb_used_data":371611300,"kb_used_omap":1453,"kb_used_meta":0,"kb_avail":371611300,"statfs":{"total":383792660480,"available":380529971200,"internally_reserved":0,"allocated":380529971200,"data_stored":380529971200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1488586,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003596"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.257643+0000","last_change":"2023-09-29T23:05:04.257449+0000","last_active":"2023-09-29T23:05:04.257643+0000","last_peered":"2023-09-29T23:05:04.257643+0000","last_clean":"2023-09-29T23:05:04.257643+0000","last_became_active":"2023-09-29T23:05:04.257210+0000","last_became_peered":"2023-09-29T23:05:04.257210+0000","last_unstale":"2023-09-29T23:05:04.257643+0000","last_undegraded":"2023-09-29T23:05:04.257643+0000","last_fullsized":"2023-09-29T23:05:04.257643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:38.742119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215550+0000","last_change":"2023-09-29T23:05:04.215439+0000","last_active":"2023-09-29T23:05:04.215550+0000","last_peered":"2023-09-29T23:05:04.215550+0000","last_clean":"2023-09-29T23:05:04.215550+0000","last_became_active":"2023-09-29T23:05:04.214980+0000","last_became_peered":"2023-09-29T23:05:04.214980+0000","last_unstale":"2023-09-29T23:05:04.215550+0000","last_undegraded":"2023-09-29T23:05:04.215550+0000","last_fullsized":"2023-09-29T23:05:04.215550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:34:27.728165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.237122+0000","last_change":"2023-09-29T23:05:04.216611+0000","last_active":"2023-09-29T23:05:04.237122+0000","last_peered":"2023-09-29T23:05:04.237122+0000","last_clean":"2023-09-29T23:05:04.237122+0000","last_became_active":"2023-09-29T23:05:04.216198+0000","last_became_peered":"2023-09-29T23:05:04.216198+0000","last_unstale":"2023-09-29T23:05:04.237122+0000","last_undegraded":"2023-09-29T23:05:04.237122+0000","last_fullsized":"2023-09-29T23:05:04.237122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:35:44.332270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.241926+0000","last_change":"2023-09-29T23:05:04.241725+0000","last_active":"2023-09-29T23:05:04.241926+0000","last_peered":"2023-09-29T23:05:04.241926+0000","last_clean":"2023-09-29T23:05:04.241926+0000","last_became_active":"2023-09-29T23:05:04.241407+0000","last_became_peered":"2023-09-29T23:05:04.241407+0000","last_unstale":"2023-09-29T23:05:04.241926+0000","last_undegraded":"2023-09-29T23:05:04.241926+0000","last_fullsized":"2023-09-29T23:05:04.241926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:38:28.150922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289101+0000","last_change":"2023-09-29T23:05:04.288885+0000","last_active":"2023-09-29T23:05:04.289101+0000","last_peered":"2023-09-29T23:05:04.289101+0000","last_clean":"2023-09-29T23:05:04.289101+0000","last_became_active":"2023-09-29T23:05:04.287799+0000","last_became_peered":"2023-09-29T23:05:04.287799+0000","last_unstale":"2023-09-29T23:05:04.289101+0000","last_undegraded":"2023-09-29T23:05:04.289101+0000","last_fullsized":"2023-09-29T23:05:04.289101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:47:02.919688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.287438+0000","last_change":"2023-09-29T23:05:04.287112+0000","last_active":"2023-09-29T23:05:04.287438+0000","last_peered":"2023-09-29T23:05:04.287438+0000","last_clean":"2023-09-29T23:05:04.287438+0000","last_became_active":"2023-09-29T23:05:04.286712+0000","last_became_peered":"2023-09-29T23:05:04.286712+0000","last_unstale":"2023-09-29T23:05:04.287438+0000","last_undegraded":"2023-09-29T23:05:04.287438+0000","last_fullsized":"2023-09-29T23:05:04.287438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:29:45.889254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.283834+0000","last_change":"2023-09-29T23:05:04.283621+0000","last_active":"2023-09-29T23:05:04.283834+0000","last_peered":"2023-09-29T23:05:04.283834+0000","last_clean":"2023-09-29T23:05:04.283834+0000","last_became_active":"2023-09-29T23:05:04.283161+0000","last_became_peered":"2023-09-29T23:05:04.283161+0000","last_unstale":"2023-09-29T23:05:04.283834+0000","last_undegraded":"2023-09-29T23:05:04.283834+0000","last_fullsized":"2023-09-29T23:05:04.283834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:03.578342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.273569+0000","last_change":"2023-09-29T23:05:04.252862+0000","last_active":"2023-09-29T23:05:04.273569+0000","last_peered":"2023-09-29T23:05:04.273569+0000","last_clean":"2023-09-29T23:05:04.273569+0000","last_became_active":"2023-09-29T23:05:04.218911+0000","last_became_peered":"2023-09-29T23:05:04.218911+0000","last_unstale":"2023-09-29T23:05:04.273569+0000","last_undegraded":"2023-09-29T23:05:04.273569+0000","last_fullsized":"2023-09-29T23:05:04.273569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:13:25.338782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251870+0000","last_change":"2023-09-29T23:05:04.251712+0000","last_active":"2023-09-29T23:05:04.251870+0000","last_peered":"2023-09-29T23:05:04.251870+0000","last_clean":"2023-09-29T23:05:04.251870+0000","last_became_active":"2023-09-29T23:05:04.251307+0000","last_became_peered":"2023-09-29T23:05:04.251307+0000","last_unstale":"2023-09-29T23:05:04.251870+0000","last_undegraded":"2023-09-29T23:05:04.251870+0000","last_fullsized":"2023-09-29T23:05:04.251870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:01.217080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.213117+0000","last_change":"2023-09-29T23:05:04.207656+0000","last_active":"2023-09-29T23:05:04.213117+0000","last_peered":"2023-09-29T23:05:04.213117+0000","last_clean":"2023-09-29T23:05:04.213117+0000","last_became_active":"2023-09-29T23:05:04.207391+0000","last_became_peered":"2023-09-29T23:05:04.207391+0000","last_unstale":"2023-09-29T23:05:04.213117+0000","last_undegraded":"2023-09-29T23:05:04.213117+0000","last_fullsized":"2023-09-29T23:05:04.213117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:30:49.612686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.221774+0000","last_change":"2023-09-29T23:05:04.219341+0000","last_active":"2023-09-29T23:05:04.221774+0000","last_peered":"2023-09-29T23:05:04.221774+0000","last_clean":"2023-09-29T23:05:04.221774+0000","last_became_active":"2023-09-29T23:05:04.214471+0000","last_became_peered":"2023-09-29T23:05:04.214471+0000","last_unstale":"2023-09-29T23:05:04.221774+0000","last_undegraded":"2023-09-29T23:05:04.221774+0000","last_fullsized":"2023-09-29T23:05:04.221774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:17.918744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214371+0000","last_change":"2023-09-29T23:05:04.214126+0000","last_active":"2023-09-29T23:05:04.214371+0000","last_peered":"2023-09-29T23:05:04.214371+0000","last_clean":"2023-09-29T23:05:04.214371+0000","last_became_active":"2023-09-29T23:05:04.213622+0000","last_became_peered":"2023-09-29T23:05:04.213622+0000","last_unstale":"2023-09-29T23:05:04.214371+0000","last_undegraded":"2023-09-29T23:05:04.214371+0000","last_fullsized":"2023-09-29T23:05:04.214371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:49:54.525277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.245601+0000","last_change":"2023-09-29T23:05:04.245433+0000","last_active":"2023-09-29T23:05:04.245601+0000","last_peered":"2023-09-29T23:05:04.245601+0000","last_clean":"2023-09-29T23:05:04.245601+0000","last_became_active":"2023-09-29T23:05:04.245108+0000","last_became_peered":"2023-09-29T23:05:04.245108+0000","last_unstale":"2023-09-29T23:05:04.245601+0000","last_undegraded":"2023-09-29T23:05:04.245601+0000","last_fullsized":"2023-09-29T23:05:04.245601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:57:21.246456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.273050+0000","last_change":"2023-09-29T23:05:04.252793+0000","last_active":"2023-09-29T23:05:04.273050+0000","last_peered":"2023-09-29T23:05:04.273050+0000","last_clean":"2023-09-29T23:05:04.273050+0000","last_became_active":"2023-09-29T23:05:04.217886+0000","last_became_peered":"2023-09-29T23:05:04.217886+0000","last_unstale":"2023-09-29T23:05:04.273050+0000","last_undegraded":"2023-09-29T23:05:04.273050+0000","last_fullsized":"2023-09-29T23:05:04.273050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:19:44.907220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215685+0000","last_change":"2023-09-29T23:05:04.215591+0000","last_active":"2023-09-29T23:05:04.215685+0000","last_peered":"2023-09-29T23:05:04.215685+0000","last_clean":"2023-09-29T23:05:04.215685+0000","last_became_active":"2023-09-29T23:05:04.215340+0000","last_became_peered":"2023-09-29T23:05:04.215340+0000","last_unstale":"2023-09-29T23:05:04.215685+0000","last_undegraded":"2023-09-29T23:05:04.215685+0000","last_fullsized":"2023-09-29T23:05:04.215685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:46:26.690662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214466+0000","last_change":"2023-09-29T23:05:04.214368+0000","last_active":"2023-09-29T23:05:04.214466+0000","last_peered":"2023-09-29T23:05:04.214466+0000","last_clean":"2023-09-29T23:05:04.214466+0000","last_became_active":"2023-09-29T23:05:04.214191+0000","last_became_peered":"2023-09-29T23:05:04.214191+0000","last_unstale":"2023-09-29T23:05:04.214466+0000","last_undegraded":"2023-09-29T23:05:04.214466+0000","last_fullsized":"2023-09-29T23:05:04.214466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:03.345234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.221762+0000","last_change":"2023-09-29T23:05:04.219335+0000","last_active":"2023-09-29T23:05:04.221762+0000","last_peered":"2023-09-29T23:05:04.221762+0000","last_clean":"2023-09-29T23:05:04.221762+0000","last_became_active":"2023-09-29T23:05:04.215239+0000","last_became_peered":"2023-09-29T23:05:04.215239+0000","last_unstale":"2023-09-29T23:05:04.221762+0000","last_undegraded":"2023-09-29T23:05:04.221762+0000","last_fullsized":"2023-09-29T23:05:04.221762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:08:43.654146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251901+0000","last_change":"2023-09-29T23:05:04.249753+0000","last_active":"2023-09-29T23:05:04.251901+0000","last_peered":"2023-09-29T23:05:04.251901+0000","last_clean":"2023-09-29T23:05:04.251901+0000","last_became_active":"2023-09-29T23:05:04.242975+0000","last_became_peered":"2023-09-29T23:05:04.242975+0000","last_unstale":"2023-09-29T23:05:04.251901+0000","last_undegraded":"2023-09-29T23:05:04.251901+0000","last_fullsized":"2023-09-29T23:05:04.251901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:56.707907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.243997+0000","last_change":"2023-09-29T23:05:04.243808+0000","last_active":"2023-09-29T23:05:04.243997+0000","last_peered":"2023-09-29T23:05:04.243997+0000","last_clean":"2023-09-29T23:05:04.243997+0000","last_became_active":"2023-09-29T23:05:04.243359+0000","last_became_peered":"2023-09-29T23:05:04.243359+0000","last_unstale":"2023-09-29T23:05:04.243997+0000","last_undegraded":"2023-09-29T23:05:04.243997+0000","last_fullsized":"2023-09-29T23:05:04.243997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:44:31.354129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.205854+0000","last_change":"2023-09-29T23:05:04.200998+0000","last_active":"2023-09-29T23:05:04.205854+0000","last_peered":"2023-09-29T23:05:04.205854+0000","last_clean":"2023-09-29T23:05:04.205854+0000","last_became_active":"2023-09-29T23:05:04.200282+0000","last_became_peered":"2023-09-29T23:05:04.200282+0000","last_unstale":"2023-09-29T23:05:04.205854+0000","last_undegraded":"2023-09-29T23:05:04.205854+0000","last_fullsized":"2023-09-29T23:05:04.205854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:00:59.236159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.286652+0000","last_change":"2023-09-29T23:05:04.284770+0000","last_active":"2023-09-29T23:05:04.286652+0000","last_peered":"2023-09-29T23:05:04.286652+0000","last_clean":"2023-09-29T23:05:04.286652+0000","last_became_active":"2023-09-29T23:05:04.252823+0000","last_became_peered":"2023-09-29T23:05:04.252823+0000","last_unstale":"2023-09-29T23:05:04.286652+0000","last_undegraded":"2023-09-29T23:05:04.286652+0000","last_fullsized":"2023-09-29T23:05:04.286652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:32:26.941552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.200453+0000","last_change":"2023-09-29T23:05:04.199157+0000","last_active":"2023-09-29T23:05:04.200453+0000","last_peered":"2023-09-29T23:05:04.200453+0000","last_clean":"2023-09-29T23:05:04.200453+0000","last_became_active":"2023-09-29T23:05:04.198882+0000","last_became_peered":"2023-09-29T23:05:04.198882+0000","last_unstale":"2023-09-29T23:05:04.200453+0000","last_undegraded":"2023-09-29T23:05:04.200453+0000","last_fullsized":"2023-09-29T23:05:04.200453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:12:54.806149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.254837+0000","last_change":"2023-09-29T23:05:04.251583+0000","last_active":"2023-09-29T23:05:04.254837+0000","last_peered":"2023-09-29T23:05:04.254837+0000","last_clean":"2023-09-29T23:05:04.254837+0000","last_became_active":"2023-09-29T23:05:04.244751+0000","last_became_peered":"2023-09-29T23:05:04.244751+0000","last_unstale":"2023-09-29T23:05:04.254837+0000","last_undegraded":"2023-09-29T23:05:04.254837+0000","last_fullsized":"2023-09-29T23:05:04.254837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:25:59.686794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.287155+0000","last_change":"2023-09-29T23:05:04.283668+0000","last_active":"2023-09-29T23:05:04.287155+0000","last_peered":"2023-09-29T23:05:04.287155+0000","last_clean":"2023-09-29T23:05:04.287155+0000","last_became_active":"2023-09-29T23:05:04.273847+0000","last_became_peered":"2023-09-29T23:05:04.273847+0000","last_unstale":"2023-09-29T23:05:04.287155+0000","last_undegraded":"2023-09-29T23:05:04.287155+0000","last_fullsized":"2023-09-29T23:05:04.287155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:04:54.695586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.207402+0000","last_change":"2023-09-29T23:05:04.206976+0000","last_active":"2023-09-29T23:05:04.207402+0000","last_peered":"2023-09-29T23:05:04.207402+0000","last_clean":"2023-09-29T23:05:04.207402+0000","last_became_active":"2023-09-29T23:05:04.202100+0000","last_became_peered":"2023-09-29T23:05:04.202100+0000","last_unstale":"2023-09-29T23:05:04.207402+0000","last_undegraded":"2023-09-29T23:05:04.207402+0000","last_fullsized":"2023-09-29T23:05:04.207402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:46:35.535828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.227549+0000","last_change":"2023-09-29T23:05:04.227117+0000","last_active":"2023-09-29T23:05:04.227549+0000","last_peered":"2023-09-29T23:05:04.227549+0000","last_clean":"2023-09-29T23:05:04.227549+0000","last_became_active":"2023-09-29T23:05:04.222967+0000","last_became_peered":"2023-09-29T23:05:04.222967+0000","last_unstale":"2023-09-29T23:05:04.227549+0000","last_undegraded":"2023-09-29T23:05:04.227549+0000","last_fullsized":"2023-09-29T23:05:04.227549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:04:36.437126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.287315+0000","last_change":"2023-09-29T23:05:04.283985+0000","last_active":"2023-09-29T23:05:04.287315+0000","last_peered":"2023-09-29T23:05:04.287315+0000","last_clean":"2023-09-29T23:05:04.287315+0000","last_became_active":"2023-09-29T23:05:04.263745+0000","last_became_peered":"2023-09-29T23:05:04.263745+0000","last_unstale":"2023-09-29T23:05:04.287315+0000","last_undegraded":"2023-09-29T23:05:04.287315+0000","last_fullsized":"2023-09-29T23:05:04.287315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:15:21.618051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.228517+0000","last_change":"2023-09-29T23:05:04.227873+0000","last_active":"2023-09-29T23:05:04.228517+0000","last_peered":"2023-09-29T23:05:04.228517+0000","last_clean":"2023-09-29T23:05:04.228517+0000","last_became_active":"2023-09-29T23:05:04.221191+0000","last_became_peered":"2023-09-29T23:05:04.221191+0000","last_unstale":"2023-09-29T23:05:04.228517+0000","last_undegraded":"2023-09-29T23:05:04.228517+0000","last_fullsized":"2023-09-29T23:05:04.228517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:27:03.221776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289354+0000","last_change":"2023-09-29T23:05:04.289174+0000","last_active":"2023-09-29T23:05:04.289354+0000","last_peered":"2023-09-29T23:05:04.289354+0000","last_clean":"2023-09-29T23:05:04.289354+0000","last_became_active":"2023-09-29T23:05:04.288438+0000","last_became_peered":"2023-09-29T23:05:04.288438+0000","last_unstale":"2023-09-29T23:05:04.289354+0000","last_undegraded":"2023-09-29T23:05:04.289354+0000","last_fullsized":"2023-09-29T23:05:04.289354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:34:48.714874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.200418+0000","last_change":"2023-09-29T23:05:04.198674+0000","last_active":"2023-09-29T23:05:04.200418+0000","last_peered":"2023-09-29T23:05:04.200418+0000","last_clean":"2023-09-29T23:05:04.200418+0000","last_became_active":"2023-09-29T23:05:04.198381+0000","last_became_peered":"2023-09-29T23:05:04.198381+0000","last_unstale":"2023-09-29T23:05:04.200418+0000","last_undegraded":"2023-09-29T23:05:04.200418+0000","last_fullsized":"2023-09-29T23:05:04.200418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:03:27.134395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.256621+0000","last_change":"2023-09-29T23:05:04.254962+0000","last_active":"2023-09-29T23:05:04.256621+0000","last_peered":"2023-09-29T23:05:04.256621+0000","last_clean":"2023-09-29T23:05:04.256621+0000","last_became_active":"2023-09-29T23:05:04.250064+0000","last_became_peered":"2023-09-29T23:05:04.250064+0000","last_unstale":"2023-09-29T23:05:04.256621+0000","last_undegraded":"2023-09-29T23:05:04.256621+0000","last_fullsized":"2023-09-29T23:05:04.256621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:30:49.612686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214978+0000","last_change":"2023-09-29T23:05:04.214801+0000","last_active":"2023-09-29T23:05:04.214978+0000","last_peered":"2023-09-29T23:05:04.214978+0000","last_clean":"2023-09-29T23:05:04.214978+0000","last_became_active":"2023-09-29T23:05:04.214399+0000","last_became_peered":"2023-09-29T23:05:04.214399+0000","last_unstale":"2023-09-29T23:05:04.214978+0000","last_undegraded":"2023-09-29T23:05:04.214978+0000","last_fullsized":"2023-09-29T23:05:04.214978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:25:30.824854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.244676+0000","last_change":"2023-09-29T23:05:04.240504+0000","last_active":"2023-09-29T23:05:04.244676+0000","last_peered":"2023-09-29T23:05:04.244676+0000","last_clean":"2023-09-29T23:05:04.244676+0000","last_became_active":"2023-09-29T23:05:04.214295+0000","last_became_peered":"2023-09-29T23:05:04.214295+0000","last_unstale":"2023-09-29T23:05:04.244676+0000","last_undegraded":"2023-09-29T23:05:04.244676+0000","last_fullsized":"2023-09-29T23:05:04.244676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:17.918744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289971+0000","last_change":"2023-09-29T23:05:03.922718+0000","last_active":"2023-09-29T23:05:04.289971+0000","last_peered":"2023-09-29T23:05:04.289971+0000","last_clean":"2023-09-29T23:05:04.289971+0000","last_became_active":"2023-09-29T23:05:03.922067+0000","last_became_peered":"2023-09-29T23:05:03.922067+0000","last_unstale":"2023-09-29T23:05:04.289971+0000","last_undegraded":"2023-09-29T23:05:04.289971+0000","last_fullsized":"2023-09-29T23:05:04.289971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.286074+0000","last_change":"2023-09-29T23:05:04.285799+0000","last_active":"2023-09-29T23:05:04.286074+0000","last_peered":"2023-09-29T23:05:04.286074+0000","last_clean":"2023-09-29T23:05:04.286074+0000","last_became_active":"2023-09-29T23:05:04.285269+0000","last_became_peered":"2023-09-29T23:05:04.285269+0000","last_unstale":"2023-09-29T23:05:04.286074+0000","last_undegraded":"2023-09-29T23:05:04.286074+0000","last_fullsized":"2023-09-29T23:05:04.286074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:46:23.962799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.213085+0000","last_change":"2023-09-29T23:05:03.862184+0000","last_active":"2023-09-29T23:05:04.213085+0000","last_peered":"2023-09-29T23:05:04.213085+0000","last_clean":"2023-09-29T23:05:04.213085+0000","last_became_active":"2023-09-29T23:05:03.861944+0000","last_became_peered":"2023-09-29T23:05:03.861944+0000","last_unstale":"2023-09-29T23:05:04.213085+0000","last_undegraded":"2023-09-29T23:05:04.213085+0000","last_fullsized":"2023-09-29T23:05:04.213085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.249622+0000","last_change":"2023-09-29T23:05:04.243484+0000","last_active":"2023-09-29T23:05:04.249622+0000","last_peered":"2023-09-29T23:05:04.249622+0000","last_clean":"2023-09-29T23:05:04.249622+0000","last_became_active":"2023-09-29T23:05:04.216763+0000","last_became_peered":"2023-09-29T23:05:04.216763+0000","last_unstale":"2023-09-29T23:05:04.249622+0000","last_undegraded":"2023-09-29T23:05:04.249622+0000","last_fullsized":"2023-09-29T23:05:04.249622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:28.548035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.193790+0000","last_change":"2023-09-29T23:05:03.860077+0000","last_active":"2023-09-29T23:05:04.193790+0000","last_peered":"2023-09-29T23:05:04.193790+0000","last_clean":"2023-09-29T23:05:04.193790+0000","last_became_active":"2023-09-29T23:05:03.859776+0000","last_became_peered":"2023-09-29T23:05:03.859776+0000","last_unstale":"2023-09-29T23:05:04.193790+0000","last_undegraded":"2023-09-29T23:05:04.193790+0000","last_fullsized":"2023-09-29T23:05:04.193790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:27:57.781735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.257308+0000","last_change":"2023-09-29T23:05:04.257031+0000","last_active":"2023-09-29T23:05:04.257308+0000","last_peered":"2023-09-29T23:05:04.257308+0000","last_clean":"2023-09-29T23:05:04.257308+0000","last_became_active":"2023-09-29T23:05:04.255274+0000","last_became_peered":"2023-09-29T23:05:04.255274+0000","last_unstale":"2023-09-29T23:05:04.257308+0000","last_undegraded":"2023-09-29T23:05:04.257308+0000","last_fullsized":"2023-09-29T23:05:04.257308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:08:19.473130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.295273+0000","last_change":"2023-09-29T23:05:03.849842+0000","last_active":"2023-09-29T23:05:04.295273+0000","last_peered":"2023-09-29T23:05:04.295273+0000","last_clean":"2023-09-29T23:05:04.295273+0000","last_became_active":"2023-09-29T23:05:03.849529+0000","last_became_peered":"2023-09-29T23:05:03.849529+0000","last_unstale":"2023-09-29T23:05:04.295273+0000","last_undegraded":"2023-09-29T23:05:04.295273+0000","last_fullsized":"2023-09-29T23:05:04.295273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.282898+0000","last_change":"2023-09-29T23:05:03.853590+0000","last_active":"2023-09-29T23:05:04.282898+0000","last_peered":"2023-09-29T23:05:04.282898+0000","last_clean":"2023-09-29T23:05:04.282898+0000","last_became_active":"2023-09-29T23:05:03.853335+0000","last_became_peered":"2023-09-29T23:05:03.853335+0000","last_unstale":"2023-09-29T23:05:04.282898+0000","last_undegraded":"2023-09-29T23:05:04.282898+0000","last_fullsized":"2023-09-29T23:05:04.282898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:57:20.234700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.285465+0000","last_change":"2023-09-29T23:05:04.285189+0000","last_active":"2023-09-29T23:05:04.285465+0000","last_peered":"2023-09-29T23:05:04.285465+0000","last_clean":"2023-09-29T23:05:04.285465+0000","last_became_active":"2023-09-29T23:05:04.284565+0000","last_became_peered":"2023-09-29T23:05:04.284565+0000","last_unstale":"2023-09-29T23:05:04.285465+0000","last_undegraded":"2023-09-29T23:05:04.285465+0000","last_fullsized":"2023-09-29T23:05:04.285465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:07:06.833043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.282729+0000","last_change":"2023-09-29T23:05:03.853815+0000","last_active":"2023-09-29T23:05:04.282729+0000","last_peered":"2023-09-29T23:05:04.282729+0000","last_clean":"2023-09-29T23:05:04.282729+0000","last_became_active":"2023-09-29T23:05:03.853456+0000","last_became_peered":"2023-09-29T23:05:03.853456+0000","last_unstale":"2023-09-29T23:05:04.282729+0000","last_undegraded":"2023-09-29T23:05:04.282729+0000","last_fullsized":"2023-09-29T23:05:04.282729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.213885+0000","last_change":"2023-09-29T23:05:04.211018+0000","last_active":"2023-09-29T23:05:04.213885+0000","last_peered":"2023-09-29T23:05:04.213885+0000","last_clean":"2023-09-29T23:05:04.213885+0000","last_became_active":"2023-09-29T23:05:04.210759+0000","last_became_peered":"2023-09-29T23:05:04.210759+0000","last_unstale":"2023-09-29T23:05:04.213885+0000","last_undegraded":"2023-09-29T23:05:04.213885+0000","last_fullsized":"2023-09-29T23:05:04.213885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:28.548035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.288181+0000","last_change":"2023-09-29T23:05:03.888787+0000","last_active":"2023-09-29T23:05:04.288181+0000","last_peered":"2023-09-29T23:05:04.288181+0000","last_clean":"2023-09-29T23:05:04.288181+0000","last_became_active":"2023-09-29T23:05:03.872538+0000","last_became_peered":"2023-09-29T23:05:03.872538+0000","last_unstale":"2023-09-29T23:05:04.288181+0000","last_undegraded":"2023-09-29T23:05:04.288181+0000","last_fullsized":"2023-09-29T23:05:04.288181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:37.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.286630+0000","last_change":"2023-09-29T23:05:04.284542+0000","last_active":"2023-09-29T23:05:04.286630+0000","last_peered":"2023-09-29T23:05:04.286630+0000","last_clean":"2023-09-29T23:05:04.286630+0000","last_became_active":"2023-09-29T23:05:04.273338+0000","last_became_peered":"2023-09-29T23:05:04.273338+0000","last_unstale":"2023-09-29T23:05:04.286630+0000","last_undegraded":"2023-09-29T23:05:04.286630+0000","last_fullsized":"2023-09-29T23:05:04.286630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:32:25.478744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.194998+0000","last_change":"2023-09-29T23:05:03.875076+0000","last_active":"2023-09-29T23:05:04.194998+0000","last_peered":"2023-09-29T23:05:04.194998+0000","last_clean":"2023-09-29T23:05:04.194998+0000","last_became_active":"2023-09-29T23:05:03.862493+0000","last_became_peered":"2023-09-29T23:05:03.862493+0000","last_unstale":"2023-09-29T23:05:04.194998+0000","last_undegraded":"2023-09-29T23:05:04.194998+0000","last_fullsized":"2023-09-29T23:05:04.194998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:52.829419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.219724+0000","last_change":"2023-09-29T23:05:04.218004+0000","last_active":"2023-09-29T23:05:04.219724+0000","last_peered":"2023-09-29T23:05:04.219724+0000","last_clean":"2023-09-29T23:05:04.219724+0000","last_became_active":"2023-09-29T23:05:04.217739+0000","last_became_peered":"2023-09-29T23:05:04.217739+0000","last_unstale":"2023-09-29T23:05:04.219724+0000","last_undegraded":"2023-09-29T23:05:04.219724+0000","last_fullsized":"2023-09-29T23:05:04.219724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:42:01.814209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.244687+0000","last_change":"2023-09-29T23:05:03.879324+0000","last_active":"2023-09-29T23:05:04.244687+0000","last_peered":"2023-09-29T23:05:04.244687+0000","last_clean":"2023-09-29T23:05:04.244687+0000","last_became_active":"2023-09-29T23:05:03.874684+0000","last_became_peered":"2023-09-29T23:05:03.874684+0000","last_unstale":"2023-09-29T23:05:04.244687+0000","last_undegraded":"2023-09-29T23:05:04.244687+0000","last_fullsized":"2023-09-29T23:05:04.244687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:07:10.402882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214075+0000","last_change":"2023-09-29T23:05:04.213340+0000","last_active":"2023-09-29T23:05:04.214075+0000","last_peered":"2023-09-29T23:05:04.214075+0000","last_clean":"2023-09-29T23:05:04.214075+0000","last_became_active":"2023-09-29T23:05:04.210965+0000","last_became_peered":"2023-09-29T23:05:04.210965+0000","last_unstale":"2023-09-29T23:05:04.214075+0000","last_undegraded":"2023-09-29T23:05:04.214075+0000","last_fullsized":"2023-09-29T23:05:04.214075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:03.345234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196156+0000","last_change":"2023-09-29T23:05:03.851543+0000","last_active":"2023-09-29T23:05:04.196156+0000","last_peered":"2023-09-29T23:05:04.196156+0000","last_clean":"2023-09-29T23:05:04.196156+0000","last_became_active":"2023-09-29T23:05:03.849728+0000","last_became_peered":"2023-09-29T23:05:03.849728+0000","last_unstale":"2023-09-29T23:05:04.196156+0000","last_undegraded":"2023-09-29T23:05:04.196156+0000","last_fullsized":"2023-09-29T23:05:04.196156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.284127+0000","last_change":"2023-09-29T23:05:04.282192+0000","last_active":"2023-09-29T23:05:04.284127+0000","last_peered":"2023-09-29T23:05:04.284127+0000","last_clean":"2023-09-29T23:05:04.284127+0000","last_became_active":"2023-09-29T23:05:04.236675+0000","last_became_peered":"2023-09-29T23:05:04.236675+0000","last_unstale":"2023-09-29T23:05:04.284127+0000","last_undegraded":"2023-09-29T23:05:04.284127+0000","last_fullsized":"2023-09-29T23:05:04.284127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:03:02.248216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.202259+0000","last_change":"2023-09-29T23:05:03.873312+0000","last_active":"2023-09-29T23:05:04.202259+0000","last_peered":"2023-09-29T23:05:04.202259+0000","last_clean":"2023-09-29T23:05:04.202259+0000","last_became_active":"2023-09-29T23:05:03.867491+0000","last_became_peered":"2023-09-29T23:05:03.867491+0000","last_unstale":"2023-09-29T23:05:04.202259+0000","last_undegraded":"2023-09-29T23:05:04.202259+0000","last_fullsized":"2023-09-29T23:05:04.202259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:21:38.208894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.217230+0000","last_change":"2023-09-29T23:05:04.217019+0000","last_active":"2023-09-29T23:05:04.217230+0000","last_peered":"2023-09-29T23:05:04.217230+0000","last_clean":"2023-09-29T23:05:04.217230+0000","last_became_active":"2023-09-29T23:05:04.216375+0000","last_became_peered":"2023-09-29T23:05:04.216375+0000","last_unstale":"2023-09-29T23:05:04.217230+0000","last_undegraded":"2023-09-29T23:05:04.217230+0000","last_fullsized":"2023-09-29T23:05:04.217230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:30.237110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.202584+0000","last_change":"2023-09-29T23:05:03.878136+0000","last_active":"2023-09-29T23:05:04.202584+0000","last_peered":"2023-09-29T23:05:04.202584+0000","last_clean":"2023-09-29T23:05:04.202584+0000","last_became_active":"2023-09-29T23:05:03.872575+0000","last_became_peered":"2023-09-29T23:05:03.872575+0000","last_unstale":"2023-09-29T23:05:04.202584+0000","last_undegraded":"2023-09-29T23:05:04.202584+0000","last_fullsized":"2023-09-29T23:05:04.202584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:18:45.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215946+0000","last_change":"2023-09-29T23:05:04.213849+0000","last_active":"2023-09-29T23:05:04.215946+0000","last_peered":"2023-09-29T23:05:04.215946+0000","last_clean":"2023-09-29T23:05:04.215946+0000","last_became_active":"2023-09-29T23:05:04.210814+0000","last_became_peered":"2023-09-29T23:05:04.210814+0000","last_unstale":"2023-09-29T23:05:04.215946+0000","last_undegraded":"2023-09-29T23:05:04.215946+0000","last_fullsized":"2023-09-29T23:05:04.215946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:32:26.941552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":166,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.191250+0000","last_change":"2023-09-29T23:04:56.664338+0000","last_active":"2023-09-29T23:05:04.191250+0000","last_peered":"2023-09-29T23:05:04.191250+0000","last_clean":"2023-09-29T23:05:04.191250+0000","last_became_active":"2023-09-29T23:04:56.663441+0000","last_became_peered":"2023-09-29T23:04:56.663441+0000","last_unstale":"2023-09-29T23:05:04.191250+0000","last_undegraded":"2023-09-29T23:05:04.191250+0000","last_fullsized":"2023-09-29T23:05:04.191250+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_clean_scrub_stamp":"2023-09-29T23:04:55.640704+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:54:28.112724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196955+0000","last_change":"2023-09-29T23:04:59.797078+0000","last_active":"2023-09-29T23:05:04.196955+0000","last_peered":"2023-09-29T23:05:04.196955+0000","last_clean":"2023-09-29T23:05:04.196955+0000","last_became_active":"2023-09-29T23:04:59.795998+0000","last_became_peered":"2023-09-29T23:04:59.795998+0000","last_unstale":"2023-09-29T23:05:04.196955+0000","last_undegraded":"2023-09-29T23:05:04.196955+0000","last_fullsized":"2023-09-29T23:05:04.196955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.202646+0000","last_change":"2023-09-29T23:05:03.890967+0000","last_active":"2023-09-29T23:05:04.202646+0000","last_peered":"2023-09-29T23:05:04.202646+0000","last_clean":"2023-09-29T23:05:04.202646+0000","last_became_active":"2023-09-29T23:05:03.890727+0000","last_became_peered":"2023-09-29T23:05:03.890727+0000","last_unstale":"2023-09-29T23:05:04.202646+0000","last_undegraded":"2023-09-29T23:05:04.202646+0000","last_fullsized":"2023-09-29T23:05:04.202646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:56:45.933376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.237040+0000","last_change":"2023-09-29T23:05:04.216483+0000","last_active":"2023-09-29T23:05:04.237040+0000","last_peered":"2023-09-29T23:05:04.237040+0000","last_clean":"2023-09-29T23:05:04.237040+0000","last_became_active":"2023-09-29T23:05:04.215884+0000","last_became_peered":"2023-09-29T23:05:04.215884+0000","last_unstale":"2023-09-29T23:05:04.237040+0000","last_undegraded":"2023-09-29T23:05:04.237040+0000","last_fullsized":"2023-09-29T23:05:04.237040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:36:17.108632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195257+0000","last_change":"2023-09-29T23:04:59.798054+0000","last_active":"2023-09-29T23:05:04.195257+0000","last_peered":"2023-09-29T23:05:04.195257+0000","last_clean":"2023-09-29T23:05:04.195257+0000","last_became_active":"2023-09-29T23:04:59.797489+0000","last_became_peered":"2023-09-29T23:04:59.797489+0000","last_unstale":"2023-09-29T23:05:04.195257+0000","last_undegraded":"2023-09-29T23:05:04.195257+0000","last_fullsized":"2023-09-29T23:05:04.195257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:32:42.777486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.191583+0000","last_change":"2023-09-29T23:05:03.851676+0000","last_active":"2023-09-29T23:05:04.191583+0000","last_peered":"2023-09-29T23:05:04.191583+0000","last_clean":"2023-09-29T23:05:04.191583+0000","last_became_active":"2023-09-29T23:05:03.851368+0000","last_became_peered":"2023-09-29T23:05:03.851368+0000","last_unstale":"2023-09-29T23:05:04.191583+0000","last_undegraded":"2023-09-29T23:05:04.191583+0000","last_fullsized":"2023-09-29T23:05:04.191583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:43:41.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.254473+0000","last_change":"2023-09-29T23:05:04.251147+0000","last_active":"2023-09-29T23:05:04.254473+0000","last_peered":"2023-09-29T23:05:04.254473+0000","last_clean":"2023-09-29T23:05:04.254473+0000","last_became_active":"2023-09-29T23:05:04.248337+0000","last_became_peered":"2023-09-29T23:05:04.248337+0000","last_unstale":"2023-09-29T23:05:04.254473+0000","last_undegraded":"2023-09-29T23:05:04.254473+0000","last_fullsized":"2023-09-29T23:05:04.254473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:46:35.535828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.213083+0000","last_change":"2023-09-29T23:04:59.951828+0000","last_active":"2023-09-29T23:05:04.213083+0000","last_peered":"2023-09-29T23:05:04.213083+0000","last_clean":"2023-09-29T23:05:04.213083+0000","last_became_active":"2023-09-29T23:04:59.951181+0000","last_became_peered":"2023-09-29T23:04:59.951181+0000","last_unstale":"2023-09-29T23:05:04.213083+0000","last_undegraded":"2023-09-29T23:05:04.213083+0000","last_fullsized":"2023-09-29T23:05:04.213083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.190936+0000","last_change":"2023-09-29T23:05:03.847255+0000","last_active":"2023-09-29T23:05:04.190936+0000","last_peered":"2023-09-29T23:05:04.190936+0000","last_clean":"2023-09-29T23:05:04.190936+0000","last_became_active":"2023-09-29T23:05:03.846967+0000","last_became_peered":"2023-09-29T23:05:03.846967+0000","last_unstale":"2023-09-29T23:05:04.190936+0000","last_undegraded":"2023-09-29T23:05:04.190936+0000","last_fullsized":"2023-09-29T23:05:04.190936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:41:31.685195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215098+0000","last_change":"2023-09-29T23:05:04.213835+0000","last_active":"2023-09-29T23:05:04.215098+0000","last_peered":"2023-09-29T23:05:04.215098+0000","last_clean":"2023-09-29T23:05:04.215098+0000","last_became_active":"2023-09-29T23:05:04.210448+0000","last_became_peered":"2023-09-29T23:05:04.210448+0000","last_unstale":"2023-09-29T23:05:04.215098+0000","last_undegraded":"2023-09-29T23:05:04.215098+0000","last_fullsized":"2023-09-29T23:05:04.215098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:13:25.338782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196228+0000","last_change":"2023-09-29T23:04:59.797795+0000","last_active":"2023-09-29T23:05:04.196228+0000","last_peered":"2023-09-29T23:05:04.196228+0000","last_clean":"2023-09-29T23:05:04.196228+0000","last_became_active":"2023-09-29T23:04:59.796512+0000","last_became_peered":"2023-09-29T23:04:59.796512+0000","last_unstale":"2023-09-29T23:05:04.196228+0000","last_undegraded":"2023-09-29T23:05:04.196228+0000","last_fullsized":"2023-09-29T23:05:04.196228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196854+0000","last_change":"2023-09-29T23:05:03.848672+0000","last_active":"2023-09-29T23:05:04.196854+0000","last_peered":"2023-09-29T23:05:04.196854+0000","last_clean":"2023-09-29T23:05:04.196854+0000","last_became_active":"2023-09-29T23:05:03.848507+0000","last_became_peered":"2023-09-29T23:05:03.848507+0000","last_unstale":"2023-09-29T23:05:04.196854+0000","last_undegraded":"2023-09-29T23:05:04.196854+0000","last_fullsized":"2023-09-29T23:05:04.196854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:19:37.297844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.224301+0000","last_change":"2023-09-29T23:05:04.221133+0000","last_active":"2023-09-29T23:05:04.224301+0000","last_peered":"2023-09-29T23:05:04.224301+0000","last_clean":"2023-09-29T23:05:04.224301+0000","last_became_active":"2023-09-29T23:05:04.217328+0000","last_became_peered":"2023-09-29T23:05:04.217328+0000","last_unstale":"2023-09-29T23:05:04.224301+0000","last_undegraded":"2023-09-29T23:05:04.224301+0000","last_fullsized":"2023-09-29T23:05:04.224301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:25:30.824854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.197156+0000","last_change":"2023-09-29T23:05:03.860174+0000","last_active":"2023-09-29T23:05:04.197156+0000","last_peered":"2023-09-29T23:05:04.197156+0000","last_clean":"2023-09-29T23:05:04.197156+0000","last_became_active":"2023-09-29T23:05:03.859936+0000","last_became_peered":"2023-09-29T23:05:03.859936+0000","last_unstale":"2023-09-29T23:05:04.197156+0000","last_undegraded":"2023-09-29T23:05:04.197156+0000","last_fullsized":"2023-09-29T23:05:04.197156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:28:17.915992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196220+0000","last_change":"2023-09-29T23:04:59.952454+0000","last_active":"2023-09-29T23:05:04.196220+0000","last_peered":"2023-09-29T23:05:04.196220+0000","last_clean":"2023-09-29T23:05:04.196220+0000","last_became_active":"2023-09-29T23:04:59.951496+0000","last_became_peered":"2023-09-29T23:04:59.951496+0000","last_unstale":"2023-09-29T23:05:04.196220+0000","last_undegraded":"2023-09-29T23:05:04.196220+0000","last_fullsized":"2023-09-29T23:05:04.196220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.221477+0000","last_change":"2023-09-29T23:05:04.218913+0000","last_active":"2023-09-29T23:05:04.221477+0000","last_peered":"2023-09-29T23:05:04.221477+0000","last_clean":"2023-09-29T23:05:04.221477+0000","last_became_active":"2023-09-29T23:05:04.214274+0000","last_became_peered":"2023-09-29T23:05:04.214274+0000","last_unstale":"2023-09-29T23:05:04.221477+0000","last_undegraded":"2023-09-29T23:05:04.221477+0000","last_fullsized":"2023-09-29T23:05:04.221477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:13.653906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195181+0000","last_change":"2023-09-29T23:05:03.855922+0000","last_active":"2023-09-29T23:05:04.195181+0000","last_peered":"2023-09-29T23:05:04.195181+0000","last_clean":"2023-09-29T23:05:04.195181+0000","last_became_active":"2023-09-29T23:05:03.851814+0000","last_became_peered":"2023-09-29T23:05:03.851814+0000","last_unstale":"2023-09-29T23:05:04.195181+0000","last_undegraded":"2023-09-29T23:05:04.195181+0000","last_fullsized":"2023-09-29T23:05:04.195181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:29:31.409379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.197282+0000","last_change":"2023-09-29T23:04:59.798170+0000","last_active":"2023-09-29T23:05:04.197282+0000","last_peered":"2023-09-29T23:05:04.197282+0000","last_clean":"2023-09-29T23:05:04.197282+0000","last_became_active":"2023-09-29T23:04:59.797758+0000","last_became_peered":"2023-09-29T23:04:59.797758+0000","last_unstale":"2023-09-29T23:05:04.197282+0000","last_undegraded":"2023-09-29T23:05:04.197282+0000","last_fullsized":"2023-09-29T23:05:04.197282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:23.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.218604+0000","last_change":"2023-09-29T23:05:04.214002+0000","last_active":"2023-09-29T23:05:04.218604+0000","last_peered":"2023-09-29T23:05:04.218604+0000","last_clean":"2023-09-29T23:05:04.218604+0000","last_became_active":"2023-09-29T23:05:04.211171+0000","last_became_peered":"2023-09-29T23:05:04.211171+0000","last_unstale":"2023-09-29T23:05:04.218604+0000","last_undegraded":"2023-09-29T23:05:04.218604+0000","last_fullsized":"2023-09-29T23:05:04.218604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:47.693070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.257471+0000","last_change":"2023-09-29T23:05:03.879418+0000","last_active":"2023-09-29T23:05:04.257471+0000","last_peered":"2023-09-29T23:05:04.257471+0000","last_clean":"2023-09-29T23:05:04.257471+0000","last_became_active":"2023-09-29T23:05:03.875943+0000","last_became_peered":"2023-09-29T23:05:03.875943+0000","last_unstale":"2023-09-29T23:05:04.257471+0000","last_undegraded":"2023-09-29T23:05:04.257471+0000","last_fullsized":"2023-09-29T23:05:04.257471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:22:16.497716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.193202+0000","last_change":"2023-09-29T23:04:59.794782+0000","last_active":"2023-09-29T23:05:04.193202+0000","last_peered":"2023-09-29T23:05:04.193202+0000","last_clean":"2023-09-29T23:05:04.193202+0000","last_became_active":"2023-09-29T23:04:59.794073+0000","last_became_peered":"2023-09-29T23:04:59.794073+0000","last_unstale":"2023-09-29T23:05:04.193202+0000","last_undegraded":"2023-09-29T23:05:04.193202+0000","last_fullsized":"2023-09-29T23:05:04.193202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:44:24.462680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251889+0000","last_change":"2023-09-29T23:05:04.247583+0000","last_active":"2023-09-29T23:05:04.251889+0000","last_peered":"2023-09-29T23:05:04.251889+0000","last_clean":"2023-09-29T23:05:04.251889+0000","last_became_active":"2023-09-29T23:05:04.240435+0000","last_became_peered":"2023-09-29T23:05:04.240435+0000","last_unstale":"2023-09-29T23:05:04.251889+0000","last_undegraded":"2023-09-29T23:05:04.251889+0000","last_fullsized":"2023-09-29T23:05:04.251889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:22:03.314724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-29T23:05:05.207459+0000","last_change":"2023-09-29T23:05:03.851188+0000","last_active":"2023-09-29T23:05:05.207459+0000","last_peered":"2023-09-29T23:05:05.207459+0000","last_clean":"2023-09-29T23:05:05.207459+0000","last_became_active":"2023-09-29T23:05:03.850904+0000","last_became_peered":"2023-09-29T23:05:03.850904+0000","last_unstale":"2023-09-29T23:05:05.207459+0000","last_undegraded":"2023-09-29T23:05:05.207459+0000","last_fullsized":"2023-09-29T23:05:05.207459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:24.755498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195568+0000","last_change":"2023-09-29T23:04:59.799021+0000","last_active":"2023-09-29T23:05:04.195568+0000","last_peered":"2023-09-29T23:05:04.195568+0000","last_clean":"2023-09-29T23:05:04.195568+0000","last_became_active":"2023-09-29T23:04:59.797145+0000","last_became_peered":"2023-09-29T23:04:59.797145+0000","last_unstale":"2023-09-29T23:05:04.195568+0000","last_undegraded":"2023-09-29T23:05:04.195568+0000","last_fullsized":"2023-09-29T23:05:04.195568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:46:55.987895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214202+0000","last_change":"2023-09-29T23:05:04.213961+0000","last_active":"2023-09-29T23:05:04.214202+0000","last_peered":"2023-09-29T23:05:04.214202+0000","last_clean":"2023-09-29T23:05:04.214202+0000","last_became_active":"2023-09-29T23:05:04.213465+0000","last_became_peered":"2023-09-29T23:05:04.213465+0000","last_unstale":"2023-09-29T23:05:04.214202+0000","last_undegraded":"2023-09-29T23:05:04.214202+0000","last_fullsized":"2023-09-29T23:05:04.214202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:19:38.309600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.217738+0000","last_change":"2023-09-29T23:05:04.217546+0000","last_active":"2023-09-29T23:05:04.217738+0000","last_peered":"2023-09-29T23:05:04.217738+0000","last_clean":"2023-09-29T23:05:04.217738+0000","last_became_active":"2023-09-29T23:05:04.214680+0000","last_became_peered":"2023-09-29T23:05:04.214680+0000","last_unstale":"2023-09-29T23:05:04.217738+0000","last_undegraded":"2023-09-29T23:05:04.217738+0000","last_fullsized":"2023-09-29T23:05:04.217738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:16:39.068910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.291449+0000","last_change":"2023-09-29T23:05:03.853192+0000","last_active":"2023-09-29T23:05:04.291449+0000","last_peered":"2023-09-29T23:05:04.291449+0000","last_clean":"2023-09-29T23:05:04.291449+0000","last_became_active":"2023-09-29T23:05:03.852382+0000","last_became_peered":"2023-09-29T23:05:03.852382+0000","last_unstale":"2023-09-29T23:05:04.291449+0000","last_undegraded":"2023-09-29T23:05:04.291449+0000","last_fullsized":"2023-09-29T23:05:04.291449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:49:53.513521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214771+0000","last_change":"2023-09-29T23:05:04.213683+0000","last_active":"2023-09-29T23:05:04.214771+0000","last_peered":"2023-09-29T23:05:04.214771+0000","last_clean":"2023-09-29T23:05:04.214771+0000","last_became_active":"2023-09-29T23:05:04.213431+0000","last_became_peered":"2023-09-29T23:05:04.213431+0000","last_unstale":"2023-09-29T23:05:04.214771+0000","last_undegraded":"2023-09-29T23:05:04.214771+0000","last_fullsized":"2023-09-29T23:05:04.214771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:21:34.691582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.256718+0000","last_change":"2023-09-29T23:05:03.859535+0000","last_active":"2023-09-29T23:05:04.256718+0000","last_peered":"2023-09-29T23:05:04.256718+0000","last_clean":"2023-09-29T23:05:04.256718+0000","last_became_active":"2023-09-29T23:05:03.858960+0000","last_became_peered":"2023-09-29T23:05:03.858960+0000","last_unstale":"2023-09-29T23:05:04.256718+0000","last_undegraded":"2023-09-29T23:05:04.256718+0000","last_fullsized":"2023-09-29T23:05:04.256718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195352+0000","last_change":"2023-09-29T23:05:03.857165+0000","last_active":"2023-09-29T23:05:04.195352+0000","last_peered":"2023-09-29T23:05:04.195352+0000","last_clean":"2023-09-29T23:05:04.195352+0000","last_became_active":"2023-09-29T23:05:03.856861+0000","last_became_peered":"2023-09-29T23:05:03.856861+0000","last_unstale":"2023-09-29T23:05:04.195352+0000","last_undegraded":"2023-09-29T23:05:04.195352+0000","last_fullsized":"2023-09-29T23:05:04.195352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:36:14.657609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.285419+0000","last_change":"2023-09-29T23:05:04.285083+0000","last_active":"2023-09-29T23:05:04.285419+0000","last_peered":"2023-09-29T23:05:04.285419+0000","last_clean":"2023-09-29T23:05:04.285419+0000","last_became_active":"2023-09-29T23:05:04.284500+0000","last_became_peered":"2023-09-29T23:05:04.284500+0000","last_unstale":"2023-09-29T23:05:04.285419+0000","last_undegraded":"2023-09-29T23:05:04.285419+0000","last_fullsized":"2023-09-29T23:05:04.285419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:31:53.623960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195485+0000","last_change":"2023-09-29T23:05:03.856407+0000","last_active":"2023-09-29T23:05:04.195485+0000","last_peered":"2023-09-29T23:05:04.195485+0000","last_clean":"2023-09-29T23:05:04.195485+0000","last_became_active":"2023-09-29T23:05:03.855984+0000","last_became_peered":"2023-09-29T23:05:03.855984+0000","last_unstale":"2023-09-29T23:05:04.195485+0000","last_undegraded":"2023-09-29T23:05:04.195485+0000","last_fullsized":"2023-09-29T23:05:04.195485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:46:25.574473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251869+0000","last_change":"2023-09-29T23:05:04.247011+0000","last_active":"2023-09-29T23:05:04.251869+0000","last_peered":"2023-09-29T23:05:04.251869+0000","last_clean":"2023-09-29T23:05:04.251869+0000","last_became_active":"2023-09-29T23:05:04.240380+0000","last_became_peered":"2023-09-29T23:05:04.240380+0000","last_unstale":"2023-09-29T23:05:04.251869+0000","last_undegraded":"2023-09-29T23:05:04.251869+0000","last_fullsized":"2023-09-29T23:05:04.251869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:21:34.691582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.277505+0000","last_change":"2023-09-29T23:05:04.263213+0000","last_active":"2023-09-29T23:05:04.277505+0000","last_peered":"2023-09-29T23:05:04.277505+0000","last_clean":"2023-09-29T23:05:04.277505+0000","last_became_active":"2023-09-29T23:05:04.234635+0000","last_became_peered":"2023-09-29T23:05:04.234635+0000","last_unstale":"2023-09-29T23:05:04.277505+0000","last_undegraded":"2023-09-29T23:05:04.277505+0000","last_fullsized":"2023-09-29T23:05:04.277505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:16:13.607977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.202319+0000","last_change":"2023-09-29T23:05:03.883153+0000","last_active":"2023-09-29T23:05:04.202319+0000","last_peered":"2023-09-29T23:05:04.202319+0000","last_clean":"2023-09-29T23:05:04.202319+0000","last_became_active":"2023-09-29T23:05:03.880964+0000","last_became_peered":"2023-09-29T23:05:03.880964+0000","last_unstale":"2023-09-29T23:05:04.202319+0000","last_undegraded":"2023-09-29T23:05:04.202319+0000","last_fullsized":"2023-09-29T23:05:04.202319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:15:36.235024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214877+0000","last_change":"2023-09-29T23:05:04.213784+0000","last_active":"2023-09-29T23:05:04.214877+0000","last_peered":"2023-09-29T23:05:04.214877+0000","last_clean":"2023-09-29T23:05:04.214877+0000","last_became_active":"2023-09-29T23:05:04.213499+0000","last_became_peered":"2023-09-29T23:05:04.213499+0000","last_unstale":"2023-09-29T23:05:04.214877+0000","last_undegraded":"2023-09-29T23:05:04.214877+0000","last_fullsized":"2023-09-29T23:05:04.214877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:57:25.282750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.191084+0000","last_change":"2023-09-29T23:05:03.865070+0000","last_active":"2023-09-29T23:05:04.191084+0000","last_peered":"2023-09-29T23:05:04.191084+0000","last_clean":"2023-09-29T23:05:04.191084+0000","last_became_active":"2023-09-29T23:05:03.859573+0000","last_became_peered":"2023-09-29T23:05:03.859573+0000","last_unstale":"2023-09-29T23:05:04.191084+0000","last_undegraded":"2023-09-29T23:05:04.191084+0000","last_fullsized":"2023-09-29T23:05:04.191084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251877+0000","last_change":"2023-09-29T23:05:04.247674+0000","last_active":"2023-09-29T23:05:04.251877+0000","last_peered":"2023-09-29T23:05:04.251877+0000","last_clean":"2023-09-29T23:05:04.251877+0000","last_became_active":"2023-09-29T23:05:04.242811+0000","last_became_peered":"2023-09-29T23:05:04.242811+0000","last_unstale":"2023-09-29T23:05:04.251877+0000","last_undegraded":"2023-09-29T23:05:04.251877+0000","last_fullsized":"2023-09-29T23:05:04.251877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:03:27.134395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.288568+0000","last_change":"2023-09-29T23:05:03.857474+0000","last_active":"2023-09-29T23:05:04.288568+0000","last_peered":"2023-09-29T23:05:04.288568+0000","last_clean":"2023-09-29T23:05:04.288568+0000","last_became_active":"2023-09-29T23:05:03.857167+0000","last_became_peered":"2023-09-29T23:05:03.857167+0000","last_unstale":"2023-09-29T23:05:04.288568+0000","last_undegraded":"2023-09-29T23:05:04.288568+0000","last_fullsized":"2023-09-29T23:05:04.288568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:31.923909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.217544+0000","last_change":"2023-09-29T23:05:04.217335+0000","last_active":"2023-09-29T23:05:04.217544+0000","last_peered":"2023-09-29T23:05:04.217544+0000","last_clean":"2023-09-29T23:05:04.217544+0000","last_became_active":"2023-09-29T23:05:04.217102+0000","last_became_peered":"2023-09-29T23:05:04.217102+0000","last_unstale":"2023-09-29T23:05:04.217544+0000","last_undegraded":"2023-09-29T23:05:04.217544+0000","last_fullsized":"2023-09-29T23:05:04.217544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:44:09.407881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289348+0000","last_change":"2023-09-29T23:05:03.888717+0000","last_active":"2023-09-29T23:05:04.289348+0000","last_peered":"2023-09-29T23:05:04.289348+0000","last_clean":"2023-09-29T23:05:04.289348+0000","last_became_active":"2023-09-29T23:05:03.888471+0000","last_became_peered":"2023-09-29T23:05:03.888471+0000","last_unstale":"2023-09-29T23:05:04.289348+0000","last_undegraded":"2023-09-29T23:05:04.289348+0000","last_fullsized":"2023-09-29T23:05:04.289348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.245628+0000","last_change":"2023-09-29T23:05:04.245495+0000","last_active":"2023-09-29T23:05:04.245628+0000","last_peered":"2023-09-29T23:05:04.245628+0000","last_clean":"2023-09-29T23:05:04.245628+0000","last_became_active":"2023-09-29T23:05:04.245132+0000","last_became_peered":"2023-09-29T23:05:04.245132+0000","last_unstale":"2023-09-29T23:05:04.245628+0000","last_undegraded":"2023-09-29T23:05:04.245628+0000","last_fullsized":"2023-09-29T23:05:04.245628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:32.935665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.252903+0000","last_change":"2023-09-29T23:05:03.860597+0000","last_active":"2023-09-29T23:05:04.252903+0000","last_peered":"2023-09-29T23:05:04.252903+0000","last_clean":"2023-09-29T23:05:04.252903+0000","last_became_active":"2023-09-29T23:05:03.858980+0000","last_became_peered":"2023-09-29T23:05:03.858980+0000","last_unstale":"2023-09-29T23:05:04.252903+0000","last_undegraded":"2023-09-29T23:05:04.252903+0000","last_fullsized":"2023-09-29T23:05:04.252903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.286518+0000","last_change":"2023-09-29T23:05:04.285898+0000","last_active":"2023-09-29T23:05:04.286518+0000","last_peered":"2023-09-29T23:05:04.286518+0000","last_clean":"2023-09-29T23:05:04.286518+0000","last_became_active":"2023-09-29T23:05:04.281563+0000","last_became_peered":"2023-09-29T23:05:04.281563+0000","last_unstale":"2023-09-29T23:05:04.286518+0000","last_undegraded":"2023-09-29T23:05:04.286518+0000","last_fullsized":"2023-09-29T23:05:04.286518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:01:55.739719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289877+0000","last_change":"2023-09-29T23:05:03.852972+0000","last_active":"2023-09-29T23:05:04.289877+0000","last_peered":"2023-09-29T23:05:04.289877+0000","last_clean":"2023-09-29T23:05:04.289877+0000","last_became_active":"2023-09-29T23:05:03.852482+0000","last_became_peered":"2023-09-29T23:05:03.852482+0000","last_unstale":"2023-09-29T23:05:04.289877+0000","last_undegraded":"2023-09-29T23:05:04.289877+0000","last_fullsized":"2023-09-29T23:05:04.289877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:00.205324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.252754+0000","last_change":"2023-09-29T23:05:04.250548+0000","last_active":"2023-09-29T23:05:04.252754+0000","last_peered":"2023-09-29T23:05:04.252754+0000","last_clean":"2023-09-29T23:05:04.252754+0000","last_became_active":"2023-09-29T23:05:04.244183+0000","last_became_peered":"2023-09-29T23:05:04.244183+0000","last_unstale":"2023-09-29T23:05:04.252754+0000","last_undegraded":"2023-09-29T23:05:04.252754+0000","last_fullsized":"2023-09-29T23:05:04.252754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:18.681401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.208590+0000","last_change":"2023-09-29T23:05:03.865954+0000","last_active":"2023-09-29T23:05:04.208590+0000","last_peered":"2023-09-29T23:05:04.208590+0000","last_clean":"2023-09-29T23:05:04.208590+0000","last_became_active":"2023-09-29T23:05:03.862839+0000","last_became_peered":"2023-09-29T23:05:03.862839+0000","last_unstale":"2023-09-29T23:05:04.208590+0000","last_undegraded":"2023-09-29T23:05:04.208590+0000","last_fullsized":"2023-09-29T23:05:04.208590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:51:59.213175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215358+0000","last_change":"2023-09-29T23:05:04.215287+0000","last_active":"2023-09-29T23:05:04.215358+0000","last_peered":"2023-09-29T23:05:04.215358+0000","last_clean":"2023-09-29T23:05:04.215358+0000","last_became_active":"2023-09-29T23:05:04.214923+0000","last_became_peered":"2023-09-29T23:05:04.214923+0000","last_unstale":"2023-09-29T23:05:04.215358+0000","last_undegraded":"2023-09-29T23:05:04.215358+0000","last_fullsized":"2023-09-29T23:05:04.215358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:33:35.631951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.221893+0000","last_change":"2023-09-29T23:05:03.850861+0000","last_active":"2023-09-29T23:05:04.221893+0000","last_peered":"2023-09-29T23:05:04.221893+0000","last_clean":"2023-09-29T23:05:04.221893+0000","last_became_active":"2023-09-29T23:05:03.848098+0000","last_became_peered":"2023-09-29T23:05:03.848098+0000","last_unstale":"2023-09-29T23:05:04.221893+0000","last_undegraded":"2023-09-29T23:05:04.221893+0000","last_fullsized":"2023-09-29T23:05:04.221893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":55,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795944,"kb_used_data":92903436,"kb_used_omap":345,"kb_used_meta":0,"kb_avail":92903436,"statfs":{"total":95948165120,"available":95133118464,"internally_reserved":0,"allocated":95133118464,"data_stored":95133118464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":353426,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":37,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797036,"kb_used_data":92902344,"kb_used_omap":309,"kb_used_meta":0,"kb_avail":92902344,"statfs":{"total":95948165120,"available":95132000256,"internally_reserved":0,"allocated":95132000256,"data_stored":95132000256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":317420,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":59,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797156,"kb_used_data":92902224,"kb_used_omap":425,"kb_used_meta":0,"kb_avail":92902224,"statfs":{"total":95948165120,"available":95131877376,"internally_reserved":0,"allocated":95131877376,"data_stored":95131877376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":435349,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":59,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796084,"kb_used_data":92903296,"kb_used_omap":373,"kb_used_meta":0,"kb_avail":92903296,"statfs":{"total":95948165120,"available":95132975104,"internally_reserved":0,"allocated":95132975104,"data_stored":95132975104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":382391,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]}],"pool_statfs":[]}} 2023-09-29T23:05:16.362 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:05:16.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8b59e700 1 Processor -- start 2023-09-29T23:05:16.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8b59e700 1 -- start start 2023-09-29T23:05:16.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8b59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc8c135b90 0x7fbc8c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8b59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbc8c135f60 0x7fbc8c09a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8b59e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8c0a4550 con 0x7fbc8c0a3b40 2023-09-29T23:05:16.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8b59e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8c099870 con 0x7fbc8c135f60 2023-09-29T23:05:16.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8b59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0a3fd0 con 0x7fbc8c135b90 2023-09-29T23:05:16.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc89d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbc8c0a3b40 0x7fbc8c09dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:34864/0 (socket says 172.21.15.115:34864) 2023-09-29T23:05:16.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc89d9b700 1 -- 172.21.15.115:0/2095528979 learned_addr learned my addr 172.21.15.115:0/2095528979 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:16.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8a59c700 1 --2- 172.21.15.115:0/2095528979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc8c135b90 0x7fbc8c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8ad9d700 1 --2- 172.21.15.115:0/2095528979 >> v2:172.21.15.156:3300/0 conn(0x7fbc8c135f60 0x7fbc8c09a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8959a700 1 -- 172.21.15.115:0/2095528979 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997228779 0 0) 0x7fbc8c0a4550 con 0x7fbc8c0a3b40 2023-09-29T23:05:16.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8959a700 1 -- 172.21.15.115:0/2095528979 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc74003570 con 0x7fbc8c0a3b40 2023-09-29T23:05:16.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8a59c700 1 -- 172.21.15.115:0/2095528979 >> v2:172.21.15.156:3300/0 conn(0x7fbc8c135f60 msgr2=0x7fbc8c09a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:16.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8a59c700 1 --2- 172.21.15.115:0/2095528979 >> v2:172.21.15.156:3300/0 conn(0x7fbc8c135f60 0x7fbc8c09a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8a59c700 1 -- 172.21.15.115:0/2095528979 >> v1:172.21.15.115:6789/0 conn(0x7fbc8c0a3b40 legacy=0x7fbc8c09dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8959a700 1 -- 172.21.15.115:0/2095528979 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 486077077 0 0) 0x7fbc74003570 con 0x7fbc8c0a3b40 2023-09-29T23:05:16.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8a59c700 1 -- 172.21.15.115:0/2095528979 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c0a4290 con 0x7fbc8c135b90 2023-09-29T23:05:16.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.469+0000 7fbc8a59c700 1 --2- 172.21.15.115:0/2095528979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc8c135b90 0x7fbc8c0a3600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009910 tx=0x7fbc800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7eb567097465e75 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:16.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8959a700 1 -- 172.21.15.115:0/2095528979 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc840017f0 con 0x7fbc8c135b90 2023-09-29T23:05:16.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8959a700 1 -- 172.21.15.115:0/2095528979 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc80011420 con 0x7fbc8c135b90 2023-09-29T23:05:16.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8959a700 1 -- 172.21.15.115:0/2095528979 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc800117c0 con 0x7fbc8c135b90 2023-09-29T23:05:16.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8b59e700 1 -- 172.21.15.115:0/2095528979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc8c135b90 msgr2=0x7fbc8c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8b59e700 1 --2- 172.21.15.115:0/2095528979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc8c135b90 0x7fbc8c0a3600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009910 tx=0x7fbc800091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8b59e700 1 -- 172.21.15.115:0/2095528979 shutdown_connections 2023-09-29T23:05:16.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8b59e700 1 --2- 172.21.15.115:0/2095528979 >> v2:172.21.15.156:3300/0 conn(0x7fbc8c135f60 0x7fbc8c09a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8b59e700 1 --2- 172.21.15.115:0/2095528979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc8c135b90 0x7fbc8c0a3600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8b59e700 1 -- 172.21.15.115:0/2095528979 >> 172.21.15.115:0/2095528979 conn(0x7fbc8c0b1d20 msgr2=0x7fbc8c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:16.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8b59e700 1 -- 172.21.15.115:0/2095528979 shutdown_connections 2023-09-29T23:05:16.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8b59e700 1 -- 172.21.15.115:0/2095528979 wait complete. 2023-09-29T23:05:16.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8b59e700 1 Processor -- start 2023-09-29T23:05:16.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8b59e700 1 -- start start 2023-09-29T23:05:16.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8b59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc8c0a3b40 0x7fbc8c09ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.473+0000 7fbc8b59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc8c135b90 0x7fbc8c137e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8b59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc8c135f60 0x7fbc8c1383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8b59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c1376a0 con 0x7fbc8c0a3b40 2023-09-29T23:05:16.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8b59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c09c890 con 0x7fbc8c135b90 2023-09-29T23:05:16.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8b59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0991d0 con 0x7fbc8c135f60 2023-09-29T23:05:16.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc8c0a3b40 0x7fbc8c09ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc8c0a3b40 0x7fbc8c09ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37482/0 (socket says 172.21.15.115:37482) 2023-09-29T23:05:16.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8ad9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc8c135f60 0x7fbc8c1383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8a59c700 1 -- 172.21.15.115:0/1745242971 learned_addr learned my addr 172.21.15.115:0/1745242971 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:16.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc89d9b700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc8c135b90 0x7fbc8c137e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8ad9d700 1 -- 172.21.15.115:0/1745242971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc8c135b90 msgr2=0x7fbc8c137e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8ad9d700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc8c135b90 0x7fbc8c137e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8ad9d700 1 -- 172.21.15.115:0/1745242971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc8c0a3b40 msgr2=0x7fbc8c09ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8ad9d700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc8c0a3b40 0x7fbc8c09ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8ad9d700 1 -- 172.21.15.115:0/1745242971 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc80009420 con 0x7fbc8c135f60 2023-09-29T23:05:16.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8a59c700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc8c0a3b40 0x7fbc8c09ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:16.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8ad9d700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc8c135f60 0x7fbc8c1383c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00e950 tx=0x7fbc7c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:16.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc7a7fc700 1 -- 172.21.15.115:0/1745242971 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c013680 con 0x7fbc8c135f60 2023-09-29T23:05:16.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc7a7fc700 1 -- 172.21.15.115:0/1745242971 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c013800 con 0x7fbc8c135f60 2023-09-29T23:05:16.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8b59e700 1 -- 172.21.15.115:0/1745242971 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8c14f530 con 0x7fbc8c135f60 2023-09-29T23:05:16.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc7a7fc700 1 -- 172.21.15.115:0/1745242971 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c013bc0 con 0x7fbc8c135f60 2023-09-29T23:05:16.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8b59e700 1 -- 172.21.15.115:0/1745242971 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c09e4a0 con 0x7fbc8c135f60 2023-09-29T23:05:16.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.477+0000 7fbc8b59e700 1 -- 172.21.15.115:0/1745242971 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8c04be00 con 0x7fbc8c135f60 2023-09-29T23:05:16.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.481+0000 7fbc7a7fc700 1 -- 172.21.15.115:0/1745242971 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fbc7c00c3e0 con 0x7fbc8c135f60 2023-09-29T23:05:16.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.481+0000 7fbc7a7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:16.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.481+0000 7fbc7a7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:16.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.481+0000 7fbc7a7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:16.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.481+0000 7fbc7a7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:16.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.481+0000 7fbc7a7fc700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbc6c08e8b0 0x7fbc6c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.481+0000 7fbc7a7fc700 1 -- 172.21.15.115:0/1745242971 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fbc7c0b47d0 con 0x7fbc8c135f60 2023-09-29T23:05:16.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.481+0000 7fbc8a59c700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbc6c08e8b0 0x7fbc6c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.481+0000 7fbc8a59c700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbc6c08e8b0 0x7fbc6c090d60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000a010 tx=0x7fbc80016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:16.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.489+0000 7fbc7a7fc700 1 -- 172.21.15.115:0/1745242971 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbc7c0851f0 con 0x7fbc8c135f60 2023-09-29T23:05:16.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.645+0000 7fbc8b59e700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-29T23:05:16.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.645+0000 7fbc8b59e700 1 -- 172.21.15.115:0/1745242971 --> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc8c09a7e0 con 0x7fbc6c08e8b0 2023-09-29T23:05:16.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.657+0000 7fbc7a7fc700 1 -- 172.21.15.115:0/1745242971 <== mgr.4107 v2:172.21.15.156:6824/26644 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+266310 (secure 0 0 0) 0x7fbc8c09a7e0 con 0x7fbc6c08e8b0 2023-09-29T23:05:16.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.657+0000 7fbc7a7fc700 20 mgrc handle_command_reply tid 0 r 0 2023-09-29T23:05:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:16.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.665+0000 7fbc8b59e700 10 mgrc shutdown 2023-09-29T23:05:16.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.665+0000 7fbc8b59e700 1 -- 172.21.15.115:0/1745242971 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbc6c08e8b0 msgr2=0x7fbc6c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.665+0000 7fbc8b59e700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbc6c08e8b0 0x7fbc6c090d60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000a010 tx=0x7fbc80016000 comp rx=0 tx=0).stop 2023-09-29T23:05:16.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.665+0000 7fbc8b59e700 1 -- 172.21.15.115:0/1745242971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc8c135f60 msgr2=0x7fbc8c1383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.665+0000 7fbc8b59e700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc8c135f60 0x7fbc8c1383c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00e950 tx=0x7fbc7c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.665+0000 7fbc8b59e700 1 -- 172.21.15.115:0/1745242971 shutdown_connections 2023-09-29T23:05:16.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.665+0000 7fbc8b59e700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc8c135f60 0x7fbc8c1383c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.665+0000 7fbc8b59e700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc8c135b90 0x7fbc8c137e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.665+0000 7fbc8b59e700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbc6c08e8b0 0x7fbc6c090d60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.665+0000 7fbc8b59e700 1 --2- 172.21.15.115:0/1745242971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc8c0a3b40 0x7fbc8c09ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.665+0000 7fbc8b59e700 1 -- 172.21.15.115:0/1745242971 >> 172.21.15.115:0/1745242971 conn(0x7fbc8c0b1d20 msgr2=0x7fbc8c0b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:16.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.665+0000 7fbc8b59e700 1 -- 172.21.15.115:0/1745242971 shutdown_connections 2023-09-29T23:05:16.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.665+0000 7fbc8b59e700 1 -- 172.21.15.115:0/1745242971 wait complete. 2023-09-29T23:05:16.668 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2023-09-29T23:05:16.680 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-09-29T23:05:14.841795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":374797520,"kb_used":3186220,"kb_used_data":371611300,"kb_used_omap":1453,"kb_used_meta":0,"kb_avail":371611300,"statfs":{"total":383792660480,"available":380529971200,"internally_reserved":0,"allocated":380529971200,"data_stored":380529971200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1488586,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003596"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.257643+0000","last_change":"2023-09-29T23:05:04.257449+0000","last_active":"2023-09-29T23:05:04.257643+0000","last_peered":"2023-09-29T23:05:04.257643+0000","last_clean":"2023-09-29T23:05:04.257643+0000","last_became_active":"2023-09-29T23:05:04.257210+0000","last_became_peered":"2023-09-29T23:05:04.257210+0000","last_unstale":"2023-09-29T23:05:04.257643+0000","last_undegraded":"2023-09-29T23:05:04.257643+0000","last_fullsized":"2023-09-29T23:05:04.257643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:38.742119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215550+0000","last_change":"2023-09-29T23:05:04.215439+0000","last_active":"2023-09-29T23:05:04.215550+0000","last_peered":"2023-09-29T23:05:04.215550+0000","last_clean":"2023-09-29T23:05:04.215550+0000","last_became_active":"2023-09-29T23:05:04.214980+0000","last_became_peered":"2023-09-29T23:05:04.214980+0000","last_unstale":"2023-09-29T23:05:04.215550+0000","last_undegraded":"2023-09-29T23:05:04.215550+0000","last_fullsized":"2023-09-29T23:05:04.215550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:34:27.728165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.237122+0000","last_change":"2023-09-29T23:05:04.216611+0000","last_active":"2023-09-29T23:05:04.237122+0000","last_peered":"2023-09-29T23:05:04.237122+0000","last_clean":"2023-09-29T23:05:04.237122+0000","last_became_active":"2023-09-29T23:05:04.216198+0000","last_became_peered":"2023-09-29T23:05:04.216198+0000","last_unstale":"2023-09-29T23:05:04.237122+0000","last_undegraded":"2023-09-29T23:05:04.237122+0000","last_fullsized":"2023-09-29T23:05:04.237122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:35:44.332270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.241926+0000","last_change":"2023-09-29T23:05:04.241725+0000","last_active":"2023-09-29T23:05:04.241926+0000","last_peered":"2023-09-29T23:05:04.241926+0000","last_clean":"2023-09-29T23:05:04.241926+0000","last_became_active":"2023-09-29T23:05:04.241407+0000","last_became_peered":"2023-09-29T23:05:04.241407+0000","last_unstale":"2023-09-29T23:05:04.241926+0000","last_undegraded":"2023-09-29T23:05:04.241926+0000","last_fullsized":"2023-09-29T23:05:04.241926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:38:28.150922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289101+0000","last_change":"2023-09-29T23:05:04.288885+0000","last_active":"2023-09-29T23:05:04.289101+0000","last_peered":"2023-09-29T23:05:04.289101+0000","last_clean":"2023-09-29T23:05:04.289101+0000","last_became_active":"2023-09-29T23:05:04.287799+0000","last_became_peered":"2023-09-29T23:05:04.287799+0000","last_unstale":"2023-09-29T23:05:04.289101+0000","last_undegraded":"2023-09-29T23:05:04.289101+0000","last_fullsized":"2023-09-29T23:05:04.289101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:47:02.919688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.287438+0000","last_change":"2023-09-29T23:05:04.287112+0000","last_active":"2023-09-29T23:05:04.287438+0000","last_peered":"2023-09-29T23:05:04.287438+0000","last_clean":"2023-09-29T23:05:04.287438+0000","last_became_active":"2023-09-29T23:05:04.286712+0000","last_became_peered":"2023-09-29T23:05:04.286712+0000","last_unstale":"2023-09-29T23:05:04.287438+0000","last_undegraded":"2023-09-29T23:05:04.287438+0000","last_fullsized":"2023-09-29T23:05:04.287438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:29:45.889254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.283834+0000","last_change":"2023-09-29T23:05:04.283621+0000","last_active":"2023-09-29T23:05:04.283834+0000","last_peered":"2023-09-29T23:05:04.283834+0000","last_clean":"2023-09-29T23:05:04.283834+0000","last_became_active":"2023-09-29T23:05:04.283161+0000","last_became_peered":"2023-09-29T23:05:04.283161+0000","last_unstale":"2023-09-29T23:05:04.283834+0000","last_undegraded":"2023-09-29T23:05:04.283834+0000","last_fullsized":"2023-09-29T23:05:04.283834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:03.578342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.273569+0000","last_change":"2023-09-29T23:05:04.252862+0000","last_active":"2023-09-29T23:05:04.273569+0000","last_peered":"2023-09-29T23:05:04.273569+0000","last_clean":"2023-09-29T23:05:04.273569+0000","last_became_active":"2023-09-29T23:05:04.218911+0000","last_became_peered":"2023-09-29T23:05:04.218911+0000","last_unstale":"2023-09-29T23:05:04.273569+0000","last_undegraded":"2023-09-29T23:05:04.273569+0000","last_fullsized":"2023-09-29T23:05:04.273569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:13:25.338782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251870+0000","last_change":"2023-09-29T23:05:04.251712+0000","last_active":"2023-09-29T23:05:04.251870+0000","last_peered":"2023-09-29T23:05:04.251870+0000","last_clean":"2023-09-29T23:05:04.251870+0000","last_became_active":"2023-09-29T23:05:04.251307+0000","last_became_peered":"2023-09-29T23:05:04.251307+0000","last_unstale":"2023-09-29T23:05:04.251870+0000","last_undegraded":"2023-09-29T23:05:04.251870+0000","last_fullsized":"2023-09-29T23:05:04.251870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:01.217080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.213117+0000","last_change":"2023-09-29T23:05:04.207656+0000","last_active":"2023-09-29T23:05:04.213117+0000","last_peered":"2023-09-29T23:05:04.213117+0000","last_clean":"2023-09-29T23:05:04.213117+0000","last_became_active":"2023-09-29T23:05:04.207391+0000","last_became_peered":"2023-09-29T23:05:04.207391+0000","last_unstale":"2023-09-29T23:05:04.213117+0000","last_undegraded":"2023-09-29T23:05:04.213117+0000","last_fullsized":"2023-09-29T23:05:04.213117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:30:49.612686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.221774+0000","last_change":"2023-09-29T23:05:04.219341+0000","last_active":"2023-09-29T23:05:04.221774+0000","last_peered":"2023-09-29T23:05:04.221774+0000","last_clean":"2023-09-29T23:05:04.221774+0000","last_became_active":"2023-09-29T23:05:04.214471+0000","last_became_peered":"2023-09-29T23:05:04.214471+0000","last_unstale":"2023-09-29T23:05:04.221774+0000","last_undegraded":"2023-09-29T23:05:04.221774+0000","last_fullsized":"2023-09-29T23:05:04.221774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:17.918744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214371+0000","last_change":"2023-09-29T23:05:04.214126+0000","last_active":"2023-09-29T23:05:04.214371+0000","last_peered":"2023-09-29T23:05:04.214371+0000","last_clean":"2023-09-29T23:05:04.214371+0000","last_became_active":"2023-09-29T23:05:04.213622+0000","last_became_peered":"2023-09-29T23:05:04.213622+0000","last_unstale":"2023-09-29T23:05:04.214371+0000","last_undegraded":"2023-09-29T23:05:04.214371+0000","last_fullsized":"2023-09-29T23:05:04.214371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:49:54.525277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.245601+0000","last_change":"2023-09-29T23:05:04.245433+0000","last_active":"2023-09-29T23:05:04.245601+0000","last_peered":"2023-09-29T23:05:04.245601+0000","last_clean":"2023-09-29T23:05:04.245601+0000","last_became_active":"2023-09-29T23:05:04.245108+0000","last_became_peered":"2023-09-29T23:05:04.245108+0000","last_unstale":"2023-09-29T23:05:04.245601+0000","last_undegraded":"2023-09-29T23:05:04.245601+0000","last_fullsized":"2023-09-29T23:05:04.245601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:57:21.246456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.273050+0000","last_change":"2023-09-29T23:05:04.252793+0000","last_active":"2023-09-29T23:05:04.273050+0000","last_peered":"2023-09-29T23:05:04.273050+0000","last_clean":"2023-09-29T23:05:04.273050+0000","last_became_active":"2023-09-29T23:05:04.217886+0000","last_became_peered":"2023-09-29T23:05:04.217886+0000","last_unstale":"2023-09-29T23:05:04.273050+0000","last_undegraded":"2023-09-29T23:05:04.273050+0000","last_fullsized":"2023-09-29T23:05:04.273050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:19:44.907220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215685+0000","last_change":"2023-09-29T23:05:04.215591+0000","last_active":"2023-09-29T23:05:04.215685+0000","last_peered":"2023-09-29T23:05:04.215685+0000","last_clean":"2023-09-29T23:05:04.215685+0000","last_became_active":"2023-09-29T23:05:04.215340+0000","last_became_peered":"2023-09-29T23:05:04.215340+0000","last_unstale":"2023-09-29T23:05:04.215685+0000","last_undegraded":"2023-09-29T23:05:04.215685+0000","last_fullsized":"2023-09-29T23:05:04.215685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:46:26.690662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214466+0000","last_change":"2023-09-29T23:05:04.214368+0000","last_active":"2023-09-29T23:05:04.214466+0000","last_peered":"2023-09-29T23:05:04.214466+0000","last_clean":"2023-09-29T23:05:04.214466+0000","last_became_active":"2023-09-29T23:05:04.214191+0000","last_became_peered":"2023-09-29T23:05:04.214191+0000","last_unstale":"2023-09-29T23:05:04.214466+0000","last_undegraded":"2023-09-29T23:05:04.214466+0000","last_fullsized":"2023-09-29T23:05:04.214466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:03.345234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.221762+0000","last_change":"2023-09-29T23:05:04.219335+0000","last_active":"2023-09-29T23:05:04.221762+0000","last_peered":"2023-09-29T23:05:04.221762+0000","last_clean":"2023-09-29T23:05:04.221762+0000","last_became_active":"2023-09-29T23:05:04.215239+0000","last_became_peered":"2023-09-29T23:05:04.215239+0000","last_unstale":"2023-09-29T23:05:04.221762+0000","last_undegraded":"2023-09-29T23:05:04.221762+0000","last_fullsized":"2023-09-29T23:05:04.221762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:08:43.654146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251901+0000","last_change":"2023-09-29T23:05:04.249753+0000","last_active":"2023-09-29T23:05:04.251901+0000","last_peered":"2023-09-29T23:05:04.251901+0000","last_clean":"2023-09-29T23:05:04.251901+0000","last_became_active":"2023-09-29T23:05:04.242975+0000","last_became_peered":"2023-09-29T23:05:04.242975+0000","last_unstale":"2023-09-29T23:05:04.251901+0000","last_undegraded":"2023-09-29T23:05:04.251901+0000","last_fullsized":"2023-09-29T23:05:04.251901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:56.707907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.243997+0000","last_change":"2023-09-29T23:05:04.243808+0000","last_active":"2023-09-29T23:05:04.243997+0000","last_peered":"2023-09-29T23:05:04.243997+0000","last_clean":"2023-09-29T23:05:04.243997+0000","last_became_active":"2023-09-29T23:05:04.243359+0000","last_became_peered":"2023-09-29T23:05:04.243359+0000","last_unstale":"2023-09-29T23:05:04.243997+0000","last_undegraded":"2023-09-29T23:05:04.243997+0000","last_fullsized":"2023-09-29T23:05:04.243997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:44:31.354129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.205854+0000","last_change":"2023-09-29T23:05:04.200998+0000","last_active":"2023-09-29T23:05:04.205854+0000","last_peered":"2023-09-29T23:05:04.205854+0000","last_clean":"2023-09-29T23:05:04.205854+0000","last_became_active":"2023-09-29T23:05:04.200282+0000","last_became_peered":"2023-09-29T23:05:04.200282+0000","last_unstale":"2023-09-29T23:05:04.205854+0000","last_undegraded":"2023-09-29T23:05:04.205854+0000","last_fullsized":"2023-09-29T23:05:04.205854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:00:59.236159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.286652+0000","last_change":"2023-09-29T23:05:04.284770+0000","last_active":"2023-09-29T23:05:04.286652+0000","last_peered":"2023-09-29T23:05:04.286652+0000","last_clean":"2023-09-29T23:05:04.286652+0000","last_became_active":"2023-09-29T23:05:04.252823+0000","last_became_peered":"2023-09-29T23:05:04.252823+0000","last_unstale":"2023-09-29T23:05:04.286652+0000","last_undegraded":"2023-09-29T23:05:04.286652+0000","last_fullsized":"2023-09-29T23:05:04.286652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:32:26.941552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.200453+0000","last_change":"2023-09-29T23:05:04.199157+0000","last_active":"2023-09-29T23:05:04.200453+0000","last_peered":"2023-09-29T23:05:04.200453+0000","last_clean":"2023-09-29T23:05:04.200453+0000","last_became_active":"2023-09-29T23:05:04.198882+0000","last_became_peered":"2023-09-29T23:05:04.198882+0000","last_unstale":"2023-09-29T23:05:04.200453+0000","last_undegraded":"2023-09-29T23:05:04.200453+0000","last_fullsized":"2023-09-29T23:05:04.200453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:12:54.806149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.254837+0000","last_change":"2023-09-29T23:05:04.251583+0000","last_active":"2023-09-29T23:05:04.254837+0000","last_peered":"2023-09-29T23:05:04.254837+0000","last_clean":"2023-09-29T23:05:04.254837+0000","last_became_active":"2023-09-29T23:05:04.244751+0000","last_became_peered":"2023-09-29T23:05:04.244751+0000","last_unstale":"2023-09-29T23:05:04.254837+0000","last_undegraded":"2023-09-29T23:05:04.254837+0000","last_fullsized":"2023-09-29T23:05:04.254837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:25:59.686794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.287155+0000","last_change":"2023-09-29T23:05:04.283668+0000","last_active":"2023-09-29T23:05:04.287155+0000","last_peered":"2023-09-29T23:05:04.287155+0000","last_clean":"2023-09-29T23:05:04.287155+0000","last_became_active":"2023-09-29T23:05:04.273847+0000","last_became_peered":"2023-09-29T23:05:04.273847+0000","last_unstale":"2023-09-29T23:05:04.287155+0000","last_undegraded":"2023-09-29T23:05:04.287155+0000","last_fullsized":"2023-09-29T23:05:04.287155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:04:54.695586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.207402+0000","last_change":"2023-09-29T23:05:04.206976+0000","last_active":"2023-09-29T23:05:04.207402+0000","last_peered":"2023-09-29T23:05:04.207402+0000","last_clean":"2023-09-29T23:05:04.207402+0000","last_became_active":"2023-09-29T23:05:04.202100+0000","last_became_peered":"2023-09-29T23:05:04.202100+0000","last_unstale":"2023-09-29T23:05:04.207402+0000","last_undegraded":"2023-09-29T23:05:04.207402+0000","last_fullsized":"2023-09-29T23:05:04.207402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:46:35.535828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.227549+0000","last_change":"2023-09-29T23:05:04.227117+0000","last_active":"2023-09-29T23:05:04.227549+0000","last_peered":"2023-09-29T23:05:04.227549+0000","last_clean":"2023-09-29T23:05:04.227549+0000","last_became_active":"2023-09-29T23:05:04.222967+0000","last_became_peered":"2023-09-29T23:05:04.222967+0000","last_unstale":"2023-09-29T23:05:04.227549+0000","last_undegraded":"2023-09-29T23:05:04.227549+0000","last_fullsized":"2023-09-29T23:05:04.227549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:04:36.437126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.287315+0000","last_change":"2023-09-29T23:05:04.283985+0000","last_active":"2023-09-29T23:05:04.287315+0000","last_peered":"2023-09-29T23:05:04.287315+0000","last_clean":"2023-09-29T23:05:04.287315+0000","last_became_active":"2023-09-29T23:05:04.263745+0000","last_became_peered":"2023-09-29T23:05:04.263745+0000","last_unstale":"2023-09-29T23:05:04.287315+0000","last_undegraded":"2023-09-29T23:05:04.287315+0000","last_fullsized":"2023-09-29T23:05:04.287315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:15:21.618051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.228517+0000","last_change":"2023-09-29T23:05:04.227873+0000","last_active":"2023-09-29T23:05:04.228517+0000","last_peered":"2023-09-29T23:05:04.228517+0000","last_clean":"2023-09-29T23:05:04.228517+0000","last_became_active":"2023-09-29T23:05:04.221191+0000","last_became_peered":"2023-09-29T23:05:04.221191+0000","last_unstale":"2023-09-29T23:05:04.228517+0000","last_undegraded":"2023-09-29T23:05:04.228517+0000","last_fullsized":"2023-09-29T23:05:04.228517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:27:03.221776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289354+0000","last_change":"2023-09-29T23:05:04.289174+0000","last_active":"2023-09-29T23:05:04.289354+0000","last_peered":"2023-09-29T23:05:04.289354+0000","last_clean":"2023-09-29T23:05:04.289354+0000","last_became_active":"2023-09-29T23:05:04.288438+0000","last_became_peered":"2023-09-29T23:05:04.288438+0000","last_unstale":"2023-09-29T23:05:04.289354+0000","last_undegraded":"2023-09-29T23:05:04.289354+0000","last_fullsized":"2023-09-29T23:05:04.289354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:34:48.714874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.200418+0000","last_change":"2023-09-29T23:05:04.198674+0000","last_active":"2023-09-29T23:05:04.200418+0000","last_peered":"2023-09-29T23:05:04.200418+0000","last_clean":"2023-09-29T23:05:04.200418+0000","last_became_active":"2023-09-29T23:05:04.198381+0000","last_became_peered":"2023-09-29T23:05:04.198381+0000","last_unstale":"2023-09-29T23:05:04.200418+0000","last_undegraded":"2023-09-29T23:05:04.200418+0000","last_fullsized":"2023-09-29T23:05:04.200418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:03:27.134395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.256621+0000","last_change":"2023-09-29T23:05:04.254962+0000","last_active":"2023-09-29T23:05:04.256621+0000","last_peered":"2023-09-29T23:05:04.256621+0000","last_clean":"2023-09-29T23:05:04.256621+0000","last_became_active":"2023-09-29T23:05:04.250064+0000","last_became_peered":"2023-09-29T23:05:04.250064+0000","last_unstale":"2023-09-29T23:05:04.256621+0000","last_undegraded":"2023-09-29T23:05:04.256621+0000","last_fullsized":"2023-09-29T23:05:04.256621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:30:49.612686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214978+0000","last_change":"2023-09-29T23:05:04.214801+0000","last_active":"2023-09-29T23:05:04.214978+0000","last_peered":"2023-09-29T23:05:04.214978+0000","last_clean":"2023-09-29T23:05:04.214978+0000","last_became_active":"2023-09-29T23:05:04.214399+0000","last_became_peered":"2023-09-29T23:05:04.214399+0000","last_unstale":"2023-09-29T23:05:04.214978+0000","last_undegraded":"2023-09-29T23:05:04.214978+0000","last_fullsized":"2023-09-29T23:05:04.214978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:25:30.824854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.244676+0000","last_change":"2023-09-29T23:05:04.240504+0000","last_active":"2023-09-29T23:05:04.244676+0000","last_peered":"2023-09-29T23:05:04.244676+0000","last_clean":"2023-09-29T23:05:04.244676+0000","last_became_active":"2023-09-29T23:05:04.214295+0000","last_became_peered":"2023-09-29T23:05:04.214295+0000","last_unstale":"2023-09-29T23:05:04.244676+0000","last_undegraded":"2023-09-29T23:05:04.244676+0000","last_fullsized":"2023-09-29T23:05:04.244676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:17.918744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289971+0000","last_change":"2023-09-29T23:05:03.922718+0000","last_active":"2023-09-29T23:05:04.289971+0000","last_peered":"2023-09-29T23:05:04.289971+0000","last_clean":"2023-09-29T23:05:04.289971+0000","last_became_active":"2023-09-29T23:05:03.922067+0000","last_became_peered":"2023-09-29T23:05:03.922067+0000","last_unstale":"2023-09-29T23:05:04.289971+0000","last_undegraded":"2023-09-29T23:05:04.289971+0000","last_fullsized":"2023-09-29T23:05:04.289971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.286074+0000","last_change":"2023-09-29T23:05:04.285799+0000","last_active":"2023-09-29T23:05:04.286074+0000","last_peered":"2023-09-29T23:05:04.286074+0000","last_clean":"2023-09-29T23:05:04.286074+0000","last_became_active":"2023-09-29T23:05:04.285269+0000","last_became_peered":"2023-09-29T23:05:04.285269+0000","last_unstale":"2023-09-29T23:05:04.286074+0000","last_undegraded":"2023-09-29T23:05:04.286074+0000","last_fullsized":"2023-09-29T23:05:04.286074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:46:23.962799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.213085+0000","last_change":"2023-09-29T23:05:03.862184+0000","last_active":"2023-09-29T23:05:04.213085+0000","last_peered":"2023-09-29T23:05:04.213085+0000","last_clean":"2023-09-29T23:05:04.213085+0000","last_became_active":"2023-09-29T23:05:03.861944+0000","last_became_peered":"2023-09-29T23:05:03.861944+0000","last_unstale":"2023-09-29T23:05:04.213085+0000","last_undegraded":"2023-09-29T23:05:04.213085+0000","last_fullsized":"2023-09-29T23:05:04.213085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.249622+0000","last_change":"2023-09-29T23:05:04.243484+0000","last_active":"2023-09-29T23:05:04.249622+0000","last_peered":"2023-09-29T23:05:04.249622+0000","last_clean":"2023-09-29T23:05:04.249622+0000","last_became_active":"2023-09-29T23:05:04.216763+0000","last_became_peered":"2023-09-29T23:05:04.216763+0000","last_unstale":"2023-09-29T23:05:04.249622+0000","last_undegraded":"2023-09-29T23:05:04.249622+0000","last_fullsized":"2023-09-29T23:05:04.249622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:28.548035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.193790+0000","last_change":"2023-09-29T23:05:03.860077+0000","last_active":"2023-09-29T23:05:04.193790+0000","last_peered":"2023-09-29T23:05:04.193790+0000","last_clean":"2023-09-29T23:05:04.193790+0000","last_became_active":"2023-09-29T23:05:03.859776+0000","last_became_peered":"2023-09-29T23:05:03.859776+0000","last_unstale":"2023-09-29T23:05:04.193790+0000","last_undegraded":"2023-09-29T23:05:04.193790+0000","last_fullsized":"2023-09-29T23:05:04.193790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:27:57.781735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.257308+0000","last_change":"2023-09-29T23:05:04.257031+0000","last_active":"2023-09-29T23:05:04.257308+0000","last_peered":"2023-09-29T23:05:04.257308+0000","last_clean":"2023-09-29T23:05:04.257308+0000","last_became_active":"2023-09-29T23:05:04.255274+0000","last_became_peered":"2023-09-29T23:05:04.255274+0000","last_unstale":"2023-09-29T23:05:04.257308+0000","last_undegraded":"2023-09-29T23:05:04.257308+0000","last_fullsized":"2023-09-29T23:05:04.257308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:08:19.473130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.295273+0000","last_change":"2023-09-29T23:05:03.849842+0000","last_active":"2023-09-29T23:05:04.295273+0000","last_peered":"2023-09-29T23:05:04.295273+0000","last_clean":"2023-09-29T23:05:04.295273+0000","last_became_active":"2023-09-29T23:05:03.849529+0000","last_became_peered":"2023-09-29T23:05:03.849529+0000","last_unstale":"2023-09-29T23:05:04.295273+0000","last_undegraded":"2023-09-29T23:05:04.295273+0000","last_fullsized":"2023-09-29T23:05:04.295273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.282898+0000","last_change":"2023-09-29T23:05:03.853590+0000","last_active":"2023-09-29T23:05:04.282898+0000","last_peered":"2023-09-29T23:05:04.282898+0000","last_clean":"2023-09-29T23:05:04.282898+0000","last_became_active":"2023-09-29T23:05:03.853335+0000","last_became_peered":"2023-09-29T23:05:03.853335+0000","last_unstale":"2023-09-29T23:05:04.282898+0000","last_undegraded":"2023-09-29T23:05:04.282898+0000","last_fullsized":"2023-09-29T23:05:04.282898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:57:20.234700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.285465+0000","last_change":"2023-09-29T23:05:04.285189+0000","last_active":"2023-09-29T23:05:04.285465+0000","last_peered":"2023-09-29T23:05:04.285465+0000","last_clean":"2023-09-29T23:05:04.285465+0000","last_became_active":"2023-09-29T23:05:04.284565+0000","last_became_peered":"2023-09-29T23:05:04.284565+0000","last_unstale":"2023-09-29T23:05:04.285465+0000","last_undegraded":"2023-09-29T23:05:04.285465+0000","last_fullsized":"2023-09-29T23:05:04.285465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:07:06.833043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.282729+0000","last_change":"2023-09-29T23:05:03.853815+0000","last_active":"2023-09-29T23:05:04.282729+0000","last_peered":"2023-09-29T23:05:04.282729+0000","last_clean":"2023-09-29T23:05:04.282729+0000","last_became_active":"2023-09-29T23:05:03.853456+0000","last_became_peered":"2023-09-29T23:05:03.853456+0000","last_unstale":"2023-09-29T23:05:04.282729+0000","last_undegraded":"2023-09-29T23:05:04.282729+0000","last_fullsized":"2023-09-29T23:05:04.282729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.213885+0000","last_change":"2023-09-29T23:05:04.211018+0000","last_active":"2023-09-29T23:05:04.213885+0000","last_peered":"2023-09-29T23:05:04.213885+0000","last_clean":"2023-09-29T23:05:04.213885+0000","last_became_active":"2023-09-29T23:05:04.210759+0000","last_became_peered":"2023-09-29T23:05:04.210759+0000","last_unstale":"2023-09-29T23:05:04.213885+0000","last_undegraded":"2023-09-29T23:05:04.213885+0000","last_fullsized":"2023-09-29T23:05:04.213885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:28.548035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.288181+0000","last_change":"2023-09-29T23:05:03.888787+0000","last_active":"2023-09-29T23:05:04.288181+0000","last_peered":"2023-09-29T23:05:04.288181+0000","last_clean":"2023-09-29T23:05:04.288181+0000","last_became_active":"2023-09-29T23:05:03.872538+0000","last_became_peered":"2023-09-29T23:05:03.872538+0000","last_unstale":"2023-09-29T23:05:04.288181+0000","last_undegraded":"2023-09-29T23:05:04.288181+0000","last_fullsized":"2023-09-29T23:05:04.288181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:37.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.286630+0000","last_change":"2023-09-29T23:05:04.284542+0000","last_active":"2023-09-29T23:05:04.286630+0000","last_peered":"2023-09-29T23:05:04.286630+0000","last_clean":"2023-09-29T23:05:04.286630+0000","last_became_active":"2023-09-29T23:05:04.273338+0000","last_became_peered":"2023-09-29T23:05:04.273338+0000","last_unstale":"2023-09-29T23:05:04.286630+0000","last_undegraded":"2023-09-29T23:05:04.286630+0000","last_fullsized":"2023-09-29T23:05:04.286630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:32:25.478744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.194998+0000","last_change":"2023-09-29T23:05:03.875076+0000","last_active":"2023-09-29T23:05:04.194998+0000","last_peered":"2023-09-29T23:05:04.194998+0000","last_clean":"2023-09-29T23:05:04.194998+0000","last_became_active":"2023-09-29T23:05:03.862493+0000","last_became_peered":"2023-09-29T23:05:03.862493+0000","last_unstale":"2023-09-29T23:05:04.194998+0000","last_undegraded":"2023-09-29T23:05:04.194998+0000","last_fullsized":"2023-09-29T23:05:04.194998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:52.829419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.219724+0000","last_change":"2023-09-29T23:05:04.218004+0000","last_active":"2023-09-29T23:05:04.219724+0000","last_peered":"2023-09-29T23:05:04.219724+0000","last_clean":"2023-09-29T23:05:04.219724+0000","last_became_active":"2023-09-29T23:05:04.217739+0000","last_became_peered":"2023-09-29T23:05:04.217739+0000","last_unstale":"2023-09-29T23:05:04.219724+0000","last_undegraded":"2023-09-29T23:05:04.219724+0000","last_fullsized":"2023-09-29T23:05:04.219724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:42:01.814209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.244687+0000","last_change":"2023-09-29T23:05:03.879324+0000","last_active":"2023-09-29T23:05:04.244687+0000","last_peered":"2023-09-29T23:05:04.244687+0000","last_clean":"2023-09-29T23:05:04.244687+0000","last_became_active":"2023-09-29T23:05:03.874684+0000","last_became_peered":"2023-09-29T23:05:03.874684+0000","last_unstale":"2023-09-29T23:05:04.244687+0000","last_undegraded":"2023-09-29T23:05:04.244687+0000","last_fullsized":"2023-09-29T23:05:04.244687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:07:10.402882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214075+0000","last_change":"2023-09-29T23:05:04.213340+0000","last_active":"2023-09-29T23:05:04.214075+0000","last_peered":"2023-09-29T23:05:04.214075+0000","last_clean":"2023-09-29T23:05:04.214075+0000","last_became_active":"2023-09-29T23:05:04.210965+0000","last_became_peered":"2023-09-29T23:05:04.210965+0000","last_unstale":"2023-09-29T23:05:04.214075+0000","last_undegraded":"2023-09-29T23:05:04.214075+0000","last_fullsized":"2023-09-29T23:05:04.214075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:03.345234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196156+0000","last_change":"2023-09-29T23:05:03.851543+0000","last_active":"2023-09-29T23:05:04.196156+0000","last_peered":"2023-09-29T23:05:04.196156+0000","last_clean":"2023-09-29T23:05:04.196156+0000","last_became_active":"2023-09-29T23:05:03.849728+0000","last_became_peered":"2023-09-29T23:05:03.849728+0000","last_unstale":"2023-09-29T23:05:04.196156+0000","last_undegraded":"2023-09-29T23:05:04.196156+0000","last_fullsized":"2023-09-29T23:05:04.196156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.284127+0000","last_change":"2023-09-29T23:05:04.282192+0000","last_active":"2023-09-29T23:05:04.284127+0000","last_peered":"2023-09-29T23:05:04.284127+0000","last_clean":"2023-09-29T23:05:04.284127+0000","last_became_active":"2023-09-29T23:05:04.236675+0000","last_became_peered":"2023-09-29T23:05:04.236675+0000","last_unstale":"2023-09-29T23:05:04.284127+0000","last_undegraded":"2023-09-29T23:05:04.284127+0000","last_fullsized":"2023-09-29T23:05:04.284127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:03:02.248216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.202259+0000","last_change":"2023-09-29T23:05:03.873312+0000","last_active":"2023-09-29T23:05:04.202259+0000","last_peered":"2023-09-29T23:05:04.202259+0000","last_clean":"2023-09-29T23:05:04.202259+0000","last_became_active":"2023-09-29T23:05:03.867491+0000","last_became_peered":"2023-09-29T23:05:03.867491+0000","last_unstale":"2023-09-29T23:05:04.202259+0000","last_undegraded":"2023-09-29T23:05:04.202259+0000","last_fullsized":"2023-09-29T23:05:04.202259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:21:38.208894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.217230+0000","last_change":"2023-09-29T23:05:04.217019+0000","last_active":"2023-09-29T23:05:04.217230+0000","last_peered":"2023-09-29T23:05:04.217230+0000","last_clean":"2023-09-29T23:05:04.217230+0000","last_became_active":"2023-09-29T23:05:04.216375+0000","last_became_peered":"2023-09-29T23:05:04.216375+0000","last_unstale":"2023-09-29T23:05:04.217230+0000","last_undegraded":"2023-09-29T23:05:04.217230+0000","last_fullsized":"2023-09-29T23:05:04.217230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:30.237110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.202584+0000","last_change":"2023-09-29T23:05:03.878136+0000","last_active":"2023-09-29T23:05:04.202584+0000","last_peered":"2023-09-29T23:05:04.202584+0000","last_clean":"2023-09-29T23:05:04.202584+0000","last_became_active":"2023-09-29T23:05:03.872575+0000","last_became_peered":"2023-09-29T23:05:03.872575+0000","last_unstale":"2023-09-29T23:05:04.202584+0000","last_undegraded":"2023-09-29T23:05:04.202584+0000","last_fullsized":"2023-09-29T23:05:04.202584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:18:45.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215946+0000","last_change":"2023-09-29T23:05:04.213849+0000","last_active":"2023-09-29T23:05:04.215946+0000","last_peered":"2023-09-29T23:05:04.215946+0000","last_clean":"2023-09-29T23:05:04.215946+0000","last_became_active":"2023-09-29T23:05:04.210814+0000","last_became_peered":"2023-09-29T23:05:04.210814+0000","last_unstale":"2023-09-29T23:05:04.215946+0000","last_undegraded":"2023-09-29T23:05:04.215946+0000","last_fullsized":"2023-09-29T23:05:04.215946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:32:26.941552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":166,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.191250+0000","last_change":"2023-09-29T23:04:56.664338+0000","last_active":"2023-09-29T23:05:04.191250+0000","last_peered":"2023-09-29T23:05:04.191250+0000","last_clean":"2023-09-29T23:05:04.191250+0000","last_became_active":"2023-09-29T23:04:56.663441+0000","last_became_peered":"2023-09-29T23:04:56.663441+0000","last_unstale":"2023-09-29T23:05:04.191250+0000","last_undegraded":"2023-09-29T23:05:04.191250+0000","last_fullsized":"2023-09-29T23:05:04.191250+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:55.640704+0000","last_clean_scrub_stamp":"2023-09-29T23:04:55.640704+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:54:28.112724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196955+0000","last_change":"2023-09-29T23:04:59.797078+0000","last_active":"2023-09-29T23:05:04.196955+0000","last_peered":"2023-09-29T23:05:04.196955+0000","last_clean":"2023-09-29T23:05:04.196955+0000","last_became_active":"2023-09-29T23:04:59.795998+0000","last_became_peered":"2023-09-29T23:04:59.795998+0000","last_unstale":"2023-09-29T23:05:04.196955+0000","last_undegraded":"2023-09-29T23:05:04.196955+0000","last_fullsized":"2023-09-29T23:05:04.196955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.202646+0000","last_change":"2023-09-29T23:05:03.890967+0000","last_active":"2023-09-29T23:05:04.202646+0000","last_peered":"2023-09-29T23:05:04.202646+0000","last_clean":"2023-09-29T23:05:04.202646+0000","last_became_active":"2023-09-29T23:05:03.890727+0000","last_became_peered":"2023-09-29T23:05:03.890727+0000","last_unstale":"2023-09-29T23:05:04.202646+0000","last_undegraded":"2023-09-29T23:05:04.202646+0000","last_fullsized":"2023-09-29T23:05:04.202646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:56:45.933376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.237040+0000","last_change":"2023-09-29T23:05:04.216483+0000","last_active":"2023-09-29T23:05:04.237040+0000","last_peered":"2023-09-29T23:05:04.237040+0000","last_clean":"2023-09-29T23:05:04.237040+0000","last_became_active":"2023-09-29T23:05:04.215884+0000","last_became_peered":"2023-09-29T23:05:04.215884+0000","last_unstale":"2023-09-29T23:05:04.237040+0000","last_undegraded":"2023-09-29T23:05:04.237040+0000","last_fullsized":"2023-09-29T23:05:04.237040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:36:17.108632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195257+0000","last_change":"2023-09-29T23:04:59.798054+0000","last_active":"2023-09-29T23:05:04.195257+0000","last_peered":"2023-09-29T23:05:04.195257+0000","last_clean":"2023-09-29T23:05:04.195257+0000","last_became_active":"2023-09-29T23:04:59.797489+0000","last_became_peered":"2023-09-29T23:04:59.797489+0000","last_unstale":"2023-09-29T23:05:04.195257+0000","last_undegraded":"2023-09-29T23:05:04.195257+0000","last_fullsized":"2023-09-29T23:05:04.195257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:32:42.777486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.191583+0000","last_change":"2023-09-29T23:05:03.851676+0000","last_active":"2023-09-29T23:05:04.191583+0000","last_peered":"2023-09-29T23:05:04.191583+0000","last_clean":"2023-09-29T23:05:04.191583+0000","last_became_active":"2023-09-29T23:05:03.851368+0000","last_became_peered":"2023-09-29T23:05:03.851368+0000","last_unstale":"2023-09-29T23:05:04.191583+0000","last_undegraded":"2023-09-29T23:05:04.191583+0000","last_fullsized":"2023-09-29T23:05:04.191583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:43:41.461575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.254473+0000","last_change":"2023-09-29T23:05:04.251147+0000","last_active":"2023-09-29T23:05:04.254473+0000","last_peered":"2023-09-29T23:05:04.254473+0000","last_clean":"2023-09-29T23:05:04.254473+0000","last_became_active":"2023-09-29T23:05:04.248337+0000","last_became_peered":"2023-09-29T23:05:04.248337+0000","last_unstale":"2023-09-29T23:05:04.254473+0000","last_undegraded":"2023-09-29T23:05:04.254473+0000","last_fullsized":"2023-09-29T23:05:04.254473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:46:35.535828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.213083+0000","last_change":"2023-09-29T23:04:59.951828+0000","last_active":"2023-09-29T23:05:04.213083+0000","last_peered":"2023-09-29T23:05:04.213083+0000","last_clean":"2023-09-29T23:05:04.213083+0000","last_became_active":"2023-09-29T23:04:59.951181+0000","last_became_peered":"2023-09-29T23:04:59.951181+0000","last_unstale":"2023-09-29T23:05:04.213083+0000","last_undegraded":"2023-09-29T23:05:04.213083+0000","last_fullsized":"2023-09-29T23:05:04.213083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:10.637847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.190936+0000","last_change":"2023-09-29T23:05:03.847255+0000","last_active":"2023-09-29T23:05:04.190936+0000","last_peered":"2023-09-29T23:05:04.190936+0000","last_clean":"2023-09-29T23:05:04.190936+0000","last_became_active":"2023-09-29T23:05:03.846967+0000","last_became_peered":"2023-09-29T23:05:03.846967+0000","last_unstale":"2023-09-29T23:05:04.190936+0000","last_undegraded":"2023-09-29T23:05:04.190936+0000","last_fullsized":"2023-09-29T23:05:04.190936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:41:31.685195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215098+0000","last_change":"2023-09-29T23:05:04.213835+0000","last_active":"2023-09-29T23:05:04.215098+0000","last_peered":"2023-09-29T23:05:04.215098+0000","last_clean":"2023-09-29T23:05:04.215098+0000","last_became_active":"2023-09-29T23:05:04.210448+0000","last_became_peered":"2023-09-29T23:05:04.210448+0000","last_unstale":"2023-09-29T23:05:04.215098+0000","last_undegraded":"2023-09-29T23:05:04.215098+0000","last_fullsized":"2023-09-29T23:05:04.215098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:13:25.338782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196228+0000","last_change":"2023-09-29T23:04:59.797795+0000","last_active":"2023-09-29T23:05:04.196228+0000","last_peered":"2023-09-29T23:05:04.196228+0000","last_clean":"2023-09-29T23:05:04.196228+0000","last_became_active":"2023-09-29T23:04:59.796512+0000","last_became_peered":"2023-09-29T23:04:59.796512+0000","last_unstale":"2023-09-29T23:05:04.196228+0000","last_undegraded":"2023-09-29T23:05:04.196228+0000","last_fullsized":"2023-09-29T23:05:04.196228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196854+0000","last_change":"2023-09-29T23:05:03.848672+0000","last_active":"2023-09-29T23:05:04.196854+0000","last_peered":"2023-09-29T23:05:04.196854+0000","last_clean":"2023-09-29T23:05:04.196854+0000","last_became_active":"2023-09-29T23:05:03.848507+0000","last_became_peered":"2023-09-29T23:05:03.848507+0000","last_unstale":"2023-09-29T23:05:04.196854+0000","last_undegraded":"2023-09-29T23:05:04.196854+0000","last_fullsized":"2023-09-29T23:05:04.196854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:19:37.297844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.224301+0000","last_change":"2023-09-29T23:05:04.221133+0000","last_active":"2023-09-29T23:05:04.224301+0000","last_peered":"2023-09-29T23:05:04.224301+0000","last_clean":"2023-09-29T23:05:04.224301+0000","last_became_active":"2023-09-29T23:05:04.217328+0000","last_became_peered":"2023-09-29T23:05:04.217328+0000","last_unstale":"2023-09-29T23:05:04.224301+0000","last_undegraded":"2023-09-29T23:05:04.224301+0000","last_fullsized":"2023-09-29T23:05:04.224301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:25:30.824854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.197156+0000","last_change":"2023-09-29T23:05:03.860174+0000","last_active":"2023-09-29T23:05:04.197156+0000","last_peered":"2023-09-29T23:05:04.197156+0000","last_clean":"2023-09-29T23:05:04.197156+0000","last_became_active":"2023-09-29T23:05:03.859936+0000","last_became_peered":"2023-09-29T23:05:03.859936+0000","last_unstale":"2023-09-29T23:05:04.197156+0000","last_undegraded":"2023-09-29T23:05:04.197156+0000","last_fullsized":"2023-09-29T23:05:04.197156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:28:17.915992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.196220+0000","last_change":"2023-09-29T23:04:59.952454+0000","last_active":"2023-09-29T23:05:04.196220+0000","last_peered":"2023-09-29T23:05:04.196220+0000","last_clean":"2023-09-29T23:05:04.196220+0000","last_became_active":"2023-09-29T23:04:59.951496+0000","last_became_peered":"2023-09-29T23:04:59.951496+0000","last_unstale":"2023-09-29T23:05:04.196220+0000","last_undegraded":"2023-09-29T23:05:04.196220+0000","last_fullsized":"2023-09-29T23:05:04.196220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:34:58.886584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.221477+0000","last_change":"2023-09-29T23:05:04.218913+0000","last_active":"2023-09-29T23:05:04.221477+0000","last_peered":"2023-09-29T23:05:04.221477+0000","last_clean":"2023-09-29T23:05:04.221477+0000","last_became_active":"2023-09-29T23:05:04.214274+0000","last_became_peered":"2023-09-29T23:05:04.214274+0000","last_unstale":"2023-09-29T23:05:04.221477+0000","last_undegraded":"2023-09-29T23:05:04.221477+0000","last_fullsized":"2023-09-29T23:05:04.221477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:13.653906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195181+0000","last_change":"2023-09-29T23:05:03.855922+0000","last_active":"2023-09-29T23:05:04.195181+0000","last_peered":"2023-09-29T23:05:04.195181+0000","last_clean":"2023-09-29T23:05:04.195181+0000","last_became_active":"2023-09-29T23:05:03.851814+0000","last_became_peered":"2023-09-29T23:05:03.851814+0000","last_unstale":"2023-09-29T23:05:04.195181+0000","last_undegraded":"2023-09-29T23:05:04.195181+0000","last_fullsized":"2023-09-29T23:05:04.195181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:29:31.409379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.197282+0000","last_change":"2023-09-29T23:04:59.798170+0000","last_active":"2023-09-29T23:05:04.197282+0000","last_peered":"2023-09-29T23:05:04.197282+0000","last_clean":"2023-09-29T23:05:04.197282+0000","last_became_active":"2023-09-29T23:04:59.797758+0000","last_became_peered":"2023-09-29T23:04:59.797758+0000","last_unstale":"2023-09-29T23:05:04.197282+0000","last_undegraded":"2023-09-29T23:05:04.197282+0000","last_fullsized":"2023-09-29T23:05:04.197282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:26:23.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.218604+0000","last_change":"2023-09-29T23:05:04.214002+0000","last_active":"2023-09-29T23:05:04.218604+0000","last_peered":"2023-09-29T23:05:04.218604+0000","last_clean":"2023-09-29T23:05:04.218604+0000","last_became_active":"2023-09-29T23:05:04.211171+0000","last_became_peered":"2023-09-29T23:05:04.211171+0000","last_unstale":"2023-09-29T23:05:04.218604+0000","last_undegraded":"2023-09-29T23:05:04.218604+0000","last_fullsized":"2023-09-29T23:05:04.218604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:47.693070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.257471+0000","last_change":"2023-09-29T23:05:03.879418+0000","last_active":"2023-09-29T23:05:04.257471+0000","last_peered":"2023-09-29T23:05:04.257471+0000","last_clean":"2023-09-29T23:05:04.257471+0000","last_became_active":"2023-09-29T23:05:03.875943+0000","last_became_peered":"2023-09-29T23:05:03.875943+0000","last_unstale":"2023-09-29T23:05:04.257471+0000","last_undegraded":"2023-09-29T23:05:04.257471+0000","last_fullsized":"2023-09-29T23:05:04.257471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:22:16.497716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.193202+0000","last_change":"2023-09-29T23:04:59.794782+0000","last_active":"2023-09-29T23:05:04.193202+0000","last_peered":"2023-09-29T23:05:04.193202+0000","last_clean":"2023-09-29T23:05:04.193202+0000","last_became_active":"2023-09-29T23:04:59.794073+0000","last_became_peered":"2023-09-29T23:04:59.794073+0000","last_unstale":"2023-09-29T23:05:04.193202+0000","last_undegraded":"2023-09-29T23:05:04.193202+0000","last_fullsized":"2023-09-29T23:05:04.193202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:44:24.462680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251889+0000","last_change":"2023-09-29T23:05:04.247583+0000","last_active":"2023-09-29T23:05:04.251889+0000","last_peered":"2023-09-29T23:05:04.251889+0000","last_clean":"2023-09-29T23:05:04.251889+0000","last_became_active":"2023-09-29T23:05:04.240435+0000","last_became_peered":"2023-09-29T23:05:04.240435+0000","last_unstale":"2023-09-29T23:05:04.251889+0000","last_undegraded":"2023-09-29T23:05:04.251889+0000","last_fullsized":"2023-09-29T23:05:04.251889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:22:03.314724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-29T23:05:05.207459+0000","last_change":"2023-09-29T23:05:03.851188+0000","last_active":"2023-09-29T23:05:05.207459+0000","last_peered":"2023-09-29T23:05:05.207459+0000","last_clean":"2023-09-29T23:05:05.207459+0000","last_became_active":"2023-09-29T23:05:03.850904+0000","last_became_peered":"2023-09-29T23:05:03.850904+0000","last_unstale":"2023-09-29T23:05:05.207459+0000","last_undegraded":"2023-09-29T23:05:05.207459+0000","last_fullsized":"2023-09-29T23:05:05.207459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:05:24.755498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195568+0000","last_change":"2023-09-29T23:04:59.799021+0000","last_active":"2023-09-29T23:05:04.195568+0000","last_peered":"2023-09-29T23:05:04.195568+0000","last_clean":"2023-09-29T23:05:04.195568+0000","last_became_active":"2023-09-29T23:04:59.797145+0000","last_became_peered":"2023-09-29T23:04:59.797145+0000","last_unstale":"2023-09-29T23:05:04.195568+0000","last_undegraded":"2023-09-29T23:05:04.195568+0000","last_fullsized":"2023-09-29T23:05:04.195568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:04:58.770035+0000","last_clean_scrub_stamp":"2023-09-29T23:04:58.770035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:46:55.987895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214202+0000","last_change":"2023-09-29T23:05:04.213961+0000","last_active":"2023-09-29T23:05:04.214202+0000","last_peered":"2023-09-29T23:05:04.214202+0000","last_clean":"2023-09-29T23:05:04.214202+0000","last_became_active":"2023-09-29T23:05:04.213465+0000","last_became_peered":"2023-09-29T23:05:04.213465+0000","last_unstale":"2023-09-29T23:05:04.214202+0000","last_undegraded":"2023-09-29T23:05:04.214202+0000","last_fullsized":"2023-09-29T23:05:04.214202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:19:38.309600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.217738+0000","last_change":"2023-09-29T23:05:04.217546+0000","last_active":"2023-09-29T23:05:04.217738+0000","last_peered":"2023-09-29T23:05:04.217738+0000","last_clean":"2023-09-29T23:05:04.217738+0000","last_became_active":"2023-09-29T23:05:04.214680+0000","last_became_peered":"2023-09-29T23:05:04.214680+0000","last_unstale":"2023-09-29T23:05:04.217738+0000","last_undegraded":"2023-09-29T23:05:04.217738+0000","last_fullsized":"2023-09-29T23:05:04.217738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:16:39.068910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.291449+0000","last_change":"2023-09-29T23:05:03.853192+0000","last_active":"2023-09-29T23:05:04.291449+0000","last_peered":"2023-09-29T23:05:04.291449+0000","last_clean":"2023-09-29T23:05:04.291449+0000","last_became_active":"2023-09-29T23:05:03.852382+0000","last_became_peered":"2023-09-29T23:05:03.852382+0000","last_unstale":"2023-09-29T23:05:04.291449+0000","last_undegraded":"2023-09-29T23:05:04.291449+0000","last_fullsized":"2023-09-29T23:05:04.291449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:49:53.513521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214771+0000","last_change":"2023-09-29T23:05:04.213683+0000","last_active":"2023-09-29T23:05:04.214771+0000","last_peered":"2023-09-29T23:05:04.214771+0000","last_clean":"2023-09-29T23:05:04.214771+0000","last_became_active":"2023-09-29T23:05:04.213431+0000","last_became_peered":"2023-09-29T23:05:04.213431+0000","last_unstale":"2023-09-29T23:05:04.214771+0000","last_undegraded":"2023-09-29T23:05:04.214771+0000","last_fullsized":"2023-09-29T23:05:04.214771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:21:34.691582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.256718+0000","last_change":"2023-09-29T23:05:03.859535+0000","last_active":"2023-09-29T23:05:04.256718+0000","last_peered":"2023-09-29T23:05:04.256718+0000","last_clean":"2023-09-29T23:05:04.256718+0000","last_became_active":"2023-09-29T23:05:03.858960+0000","last_became_peered":"2023-09-29T23:05:03.858960+0000","last_unstale":"2023-09-29T23:05:04.256718+0000","last_undegraded":"2023-09-29T23:05:04.256718+0000","last_fullsized":"2023-09-29T23:05:04.256718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:26:27.895803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195352+0000","last_change":"2023-09-29T23:05:03.857165+0000","last_active":"2023-09-29T23:05:04.195352+0000","last_peered":"2023-09-29T23:05:04.195352+0000","last_clean":"2023-09-29T23:05:04.195352+0000","last_became_active":"2023-09-29T23:05:03.856861+0000","last_became_peered":"2023-09-29T23:05:03.856861+0000","last_unstale":"2023-09-29T23:05:04.195352+0000","last_undegraded":"2023-09-29T23:05:04.195352+0000","last_fullsized":"2023-09-29T23:05:04.195352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:36:14.657609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.285419+0000","last_change":"2023-09-29T23:05:04.285083+0000","last_active":"2023-09-29T23:05:04.285419+0000","last_peered":"2023-09-29T23:05:04.285419+0000","last_clean":"2023-09-29T23:05:04.285419+0000","last_became_active":"2023-09-29T23:05:04.284500+0000","last_became_peered":"2023-09-29T23:05:04.284500+0000","last_unstale":"2023-09-29T23:05:04.285419+0000","last_undegraded":"2023-09-29T23:05:04.285419+0000","last_fullsized":"2023-09-29T23:05:04.285419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:31:53.623960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.195485+0000","last_change":"2023-09-29T23:05:03.856407+0000","last_active":"2023-09-29T23:05:04.195485+0000","last_peered":"2023-09-29T23:05:04.195485+0000","last_clean":"2023-09-29T23:05:04.195485+0000","last_became_active":"2023-09-29T23:05:03.855984+0000","last_became_peered":"2023-09-29T23:05:03.855984+0000","last_unstale":"2023-09-29T23:05:04.195485+0000","last_undegraded":"2023-09-29T23:05:04.195485+0000","last_fullsized":"2023-09-29T23:05:04.195485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:46:25.574473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251869+0000","last_change":"2023-09-29T23:05:04.247011+0000","last_active":"2023-09-29T23:05:04.251869+0000","last_peered":"2023-09-29T23:05:04.251869+0000","last_clean":"2023-09-29T23:05:04.251869+0000","last_became_active":"2023-09-29T23:05:04.240380+0000","last_became_peered":"2023-09-29T23:05:04.240380+0000","last_unstale":"2023-09-29T23:05:04.251869+0000","last_undegraded":"2023-09-29T23:05:04.251869+0000","last_fullsized":"2023-09-29T23:05:04.251869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:21:34.691582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.277505+0000","last_change":"2023-09-29T23:05:04.263213+0000","last_active":"2023-09-29T23:05:04.277505+0000","last_peered":"2023-09-29T23:05:04.277505+0000","last_clean":"2023-09-29T23:05:04.277505+0000","last_became_active":"2023-09-29T23:05:04.234635+0000","last_became_peered":"2023-09-29T23:05:04.234635+0000","last_unstale":"2023-09-29T23:05:04.277505+0000","last_undegraded":"2023-09-29T23:05:04.277505+0000","last_fullsized":"2023-09-29T23:05:04.277505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:16:13.607977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.202319+0000","last_change":"2023-09-29T23:05:03.883153+0000","last_active":"2023-09-29T23:05:04.202319+0000","last_peered":"2023-09-29T23:05:04.202319+0000","last_clean":"2023-09-29T23:05:04.202319+0000","last_became_active":"2023-09-29T23:05:03.880964+0000","last_became_peered":"2023-09-29T23:05:03.880964+0000","last_unstale":"2023-09-29T23:05:04.202319+0000","last_undegraded":"2023-09-29T23:05:04.202319+0000","last_fullsized":"2023-09-29T23:05:04.202319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:15:36.235024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.214877+0000","last_change":"2023-09-29T23:05:04.213784+0000","last_active":"2023-09-29T23:05:04.214877+0000","last_peered":"2023-09-29T23:05:04.214877+0000","last_clean":"2023-09-29T23:05:04.214877+0000","last_became_active":"2023-09-29T23:05:04.213499+0000","last_became_peered":"2023-09-29T23:05:04.213499+0000","last_unstale":"2023-09-29T23:05:04.214877+0000","last_undegraded":"2023-09-29T23:05:04.214877+0000","last_fullsized":"2023-09-29T23:05:04.214877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:57:25.282750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.191084+0000","last_change":"2023-09-29T23:05:03.865070+0000","last_active":"2023-09-29T23:05:04.191084+0000","last_peered":"2023-09-29T23:05:04.191084+0000","last_clean":"2023-09-29T23:05:04.191084+0000","last_became_active":"2023-09-29T23:05:03.859573+0000","last_became_peered":"2023-09-29T23:05:03.859573+0000","last_unstale":"2023-09-29T23:05:04.191084+0000","last_undegraded":"2023-09-29T23:05:04.191084+0000","last_fullsized":"2023-09-29T23:05:04.191084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:46.903614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.251877+0000","last_change":"2023-09-29T23:05:04.247674+0000","last_active":"2023-09-29T23:05:04.251877+0000","last_peered":"2023-09-29T23:05:04.251877+0000","last_clean":"2023-09-29T23:05:04.251877+0000","last_became_active":"2023-09-29T23:05:04.242811+0000","last_became_peered":"2023-09-29T23:05:04.242811+0000","last_unstale":"2023-09-29T23:05:04.251877+0000","last_undegraded":"2023-09-29T23:05:04.251877+0000","last_fullsized":"2023-09-29T23:05:04.251877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:03:27.134395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.288568+0000","last_change":"2023-09-29T23:05:03.857474+0000","last_active":"2023-09-29T23:05:04.288568+0000","last_peered":"2023-09-29T23:05:04.288568+0000","last_clean":"2023-09-29T23:05:04.288568+0000","last_became_active":"2023-09-29T23:05:03.857167+0000","last_became_peered":"2023-09-29T23:05:03.857167+0000","last_unstale":"2023-09-29T23:05:04.288568+0000","last_undegraded":"2023-09-29T23:05:04.288568+0000","last_fullsized":"2023-09-29T23:05:04.288568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:31.923909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.217544+0000","last_change":"2023-09-29T23:05:04.217335+0000","last_active":"2023-09-29T23:05:04.217544+0000","last_peered":"2023-09-29T23:05:04.217544+0000","last_clean":"2023-09-29T23:05:04.217544+0000","last_became_active":"2023-09-29T23:05:04.217102+0000","last_became_peered":"2023-09-29T23:05:04.217102+0000","last_unstale":"2023-09-29T23:05:04.217544+0000","last_undegraded":"2023-09-29T23:05:04.217544+0000","last_fullsized":"2023-09-29T23:05:04.217544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:44:09.407881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289348+0000","last_change":"2023-09-29T23:05:03.888717+0000","last_active":"2023-09-29T23:05:04.289348+0000","last_peered":"2023-09-29T23:05:04.289348+0000","last_clean":"2023-09-29T23:05:04.289348+0000","last_became_active":"2023-09-29T23:05:03.888471+0000","last_became_peered":"2023-09-29T23:05:03.888471+0000","last_unstale":"2023-09-29T23:05:04.289348+0000","last_undegraded":"2023-09-29T23:05:04.289348+0000","last_fullsized":"2023-09-29T23:05:04.289348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:40.334268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.245628+0000","last_change":"2023-09-29T23:05:04.245495+0000","last_active":"2023-09-29T23:05:04.245628+0000","last_peered":"2023-09-29T23:05:04.245628+0000","last_clean":"2023-09-29T23:05:04.245628+0000","last_became_active":"2023-09-29T23:05:04.245132+0000","last_became_peered":"2023-09-29T23:05:04.245132+0000","last_unstale":"2023-09-29T23:05:04.245628+0000","last_undegraded":"2023-09-29T23:05:04.245628+0000","last_fullsized":"2023-09-29T23:05:04.245628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:19:32.935665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.252903+0000","last_change":"2023-09-29T23:05:03.860597+0000","last_active":"2023-09-29T23:05:04.252903+0000","last_peered":"2023-09-29T23:05:04.252903+0000","last_clean":"2023-09-29T23:05:04.252903+0000","last_became_active":"2023-09-29T23:05:03.858980+0000","last_became_peered":"2023-09-29T23:05:03.858980+0000","last_unstale":"2023-09-29T23:05:04.252903+0000","last_undegraded":"2023-09-29T23:05:04.252903+0000","last_fullsized":"2023-09-29T23:05:04.252903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:53:07.270769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.286518+0000","last_change":"2023-09-29T23:05:04.285898+0000","last_active":"2023-09-29T23:05:04.286518+0000","last_peered":"2023-09-29T23:05:04.286518+0000","last_clean":"2023-09-29T23:05:04.286518+0000","last_became_active":"2023-09-29T23:05:04.281563+0000","last_became_peered":"2023-09-29T23:05:04.281563+0000","last_unstale":"2023-09-29T23:05:04.286518+0000","last_undegraded":"2023-09-29T23:05:04.286518+0000","last_fullsized":"2023-09-29T23:05:04.286518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:01:55.739719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.289877+0000","last_change":"2023-09-29T23:05:03.852972+0000","last_active":"2023-09-29T23:05:04.289877+0000","last_peered":"2023-09-29T23:05:04.289877+0000","last_clean":"2023-09-29T23:05:04.289877+0000","last_became_active":"2023-09-29T23:05:03.852482+0000","last_became_peered":"2023-09-29T23:05:03.852482+0000","last_unstale":"2023-09-29T23:05:04.289877+0000","last_undegraded":"2023-09-29T23:05:04.289877+0000","last_fullsized":"2023-09-29T23:05:04.289877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:16:00.205324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.252754+0000","last_change":"2023-09-29T23:05:04.250548+0000","last_active":"2023-09-29T23:05:04.252754+0000","last_peered":"2023-09-29T23:05:04.252754+0000","last_clean":"2023-09-29T23:05:04.252754+0000","last_became_active":"2023-09-29T23:05:04.244183+0000","last_became_peered":"2023-09-29T23:05:04.244183+0000","last_unstale":"2023-09-29T23:05:04.252754+0000","last_undegraded":"2023-09-29T23:05:04.252754+0000","last_fullsized":"2023-09-29T23:05:04.252754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:38:18.681401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.208590+0000","last_change":"2023-09-29T23:05:03.865954+0000","last_active":"2023-09-29T23:05:04.208590+0000","last_peered":"2023-09-29T23:05:04.208590+0000","last_clean":"2023-09-29T23:05:04.208590+0000","last_became_active":"2023-09-29T23:05:03.862839+0000","last_became_peered":"2023-09-29T23:05:03.862839+0000","last_unstale":"2023-09-29T23:05:04.208590+0000","last_undegraded":"2023-09-29T23:05:04.208590+0000","last_fullsized":"2023-09-29T23:05:04.208590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:51:59.213175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.215358+0000","last_change":"2023-09-29T23:05:04.215287+0000","last_active":"2023-09-29T23:05:04.215358+0000","last_peered":"2023-09-29T23:05:04.215358+0000","last_clean":"2023-09-29T23:05:04.215358+0000","last_became_active":"2023-09-29T23:05:04.214923+0000","last_became_peered":"2023-09-29T23:05:04.214923+0000","last_unstale":"2023-09-29T23:05:04.215358+0000","last_undegraded":"2023-09-29T23:05:04.215358+0000","last_fullsized":"2023-09-29T23:05:04.215358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:03.820986+0000","last_clean_scrub_stamp":"2023-09-29T23:05:03.820986+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:33:35.631951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:05:04.221893+0000","last_change":"2023-09-29T23:05:03.850861+0000","last_active":"2023-09-29T23:05:04.221893+0000","last_peered":"2023-09-29T23:05:04.221893+0000","last_clean":"2023-09-29T23:05:04.221893+0000","last_became_active":"2023-09-29T23:05:03.848098+0000","last_became_peered":"2023-09-29T23:05:03.848098+0000","last_unstale":"2023-09-29T23:05:04.221893+0000","last_undegraded":"2023-09-29T23:05:04.221893+0000","last_fullsized":"2023-09-29T23:05:04.221893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:05:02.809230+0000","last_clean_scrub_stamp":"2023-09-29T23:05:02.809230+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:26:29.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":55,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795944,"kb_used_data":92903436,"kb_used_omap":345,"kb_used_meta":0,"kb_avail":92903436,"statfs":{"total":95948165120,"available":95133118464,"internally_reserved":0,"allocated":95133118464,"data_stored":95133118464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":353426,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":37,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797036,"kb_used_data":92902344,"kb_used_omap":309,"kb_used_meta":0,"kb_avail":92902344,"statfs":{"total":95948165120,"available":95132000256,"internally_reserved":0,"allocated":95132000256,"data_stored":95132000256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":317420,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":59,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797156,"kb_used_data":92902224,"kb_used_omap":425,"kb_used_meta":0,"kb_avail":92902224,"statfs":{"total":95948165120,"available":95131877376,"internally_reserved":0,"allocated":95131877376,"data_stored":95131877376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":435349,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":59,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796084,"kb_used_data":92903296,"kb_used_omap":373,"kb_used_meta":0,"kb_avail":92903296,"statfs":{"total":95948165120,"available":95132975104,"internally_reserved":0,"allocated":95132975104,"data_stored":95132975104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":382391,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]}],"pool_statfs":[]}} 2023-09-29T23:05:16.687 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-29T23:05:16.687 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-29T23:05:16.687 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-29T23:05:16.687 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:05:16.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f300b93f700 1 Processor -- start 2023-09-29T23:05:16.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f300b93f700 1 -- start start 2023-09-29T23:05:16.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f300b93f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30040680b0 0x7f300409f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f300b93f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3004141570 0x7f30041419f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f300b93f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300409fd00 con 0x7f3004068480 2023-09-29T23:05:16.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f300b93f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f300409b870 con 0x7f30040680b0 2023-09-29T23:05:16.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f300b93f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3004140ff0 con 0x7f3004141570 2023-09-29T23:05:16.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f30096db700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30040680b0 0x7f300409f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f30096db700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30040680b0 0x7f300409f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37498/0 (socket says 172.21.15.115:37498) 2023-09-29T23:05:16.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f30096db700 1 -- 172.21.15.115:0/100144634 learned_addr learned my addr 172.21.15.115:0/100144634 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:16.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f30096db700 1 -- 172.21.15.115:0/100144634 >> v2:172.21.15.156:3300/0 conn(0x7f3004141570 msgr2=0x7f30041419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:16.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f3009edc700 1 --2- 172.21.15.115:0/100144634 >> v2:172.21.15.156:3300/0 conn(0x7f3004141570 0x7f30041419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f30096db700 1 --2- 172.21.15.115:0/100144634 >> v2:172.21.15.156:3300/0 conn(0x7f3004141570 0x7f30041419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f30096db700 1 -- 172.21.15.115:0/100144634 >> v1:172.21.15.156:6789/0 conn(0x7f3004068480 legacy=0x7f300409b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:16.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f30096db700 1 -- 172.21.15.115:0/100144634 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30041412b0 con 0x7f30040680b0 2023-09-29T23:05:16.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f3009edc700 1 --2- 172.21.15.115:0/100144634 >> v2:172.21.15.156:3300/0 conn(0x7f3004141570 0x7f30041419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:05:16.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f30096db700 1 --2- 172.21.15.115:0/100144634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30040680b0 0x7f300409f7c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f300409e220 tx=0x7f2ffc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc4804c1e7603d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:16.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f2ffbfff700 1 -- 172.21.15.115:0/100144634 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc00e070 con 0x7f30040680b0 2023-09-29T23:05:16.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f2ffbfff700 1 -- 172.21.15.115:0/100144634 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ffc00ba10 con 0x7f30040680b0 2023-09-29T23:05:16.798 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f2ffbfff700 1 -- 172.21.15.115:0/100144634 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc0092e0 con 0x7f30040680b0 2023-09-29T23:05:16.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f300b93f700 1 -- 172.21.15.115:0/100144634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30040680b0 msgr2=0x7f300409f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f300b93f700 1 --2- 172.21.15.115:0/100144634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30040680b0 0x7f300409f7c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f300409e220 tx=0x7f2ffc009840 comp rx=0 tx=0).stop 2023-09-29T23:05:16.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f300b93f700 1 -- 172.21.15.115:0/100144634 shutdown_connections 2023-09-29T23:05:16.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f300b93f700 1 --2- 172.21.15.115:0/100144634 >> v2:172.21.15.156:3300/0 conn(0x7f3004141570 0x7f30041419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f300b93f700 1 --2- 172.21.15.115:0/100144634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30040680b0 0x7f300409f7c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.793+0000 7f300b93f700 1 -- 172.21.15.115:0/100144634 >> 172.21.15.115:0/100144634 conn(0x7f30040695c0 msgr2=0x7f30040699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:16.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f300b93f700 1 -- 172.21.15.115:0/100144634 shutdown_connections 2023-09-29T23:05:16.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f300b93f700 1 -- 172.21.15.115:0/100144634 wait complete. 2023-09-29T23:05:16.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f300b93f700 1 Processor -- start 2023-09-29T23:05:16.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f300b93f700 1 -- start start 2023-09-29T23:05:16.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f300b93f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30040680b0 0x7f3004094ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f300b93f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068480 0x7f3004097c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f300b93f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3004141570 0x7f30040962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f300b93f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300406eda0 con 0x7f3004068480 2023-09-29T23:05:16.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f300b93f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3004095590 con 0x7f30040680b0 2023-09-29T23:05:16.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f300b93f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30040967f0 con 0x7f3004141570 2023-09-29T23:05:16.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f3008eda700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068480 0x7f3004097c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f3009edc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3004141570 0x7f30040962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f3008eda700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068480 0x7f3004097c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37500/0 (socket says 172.21.15.115:37500) 2023-09-29T23:05:16.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f3009edc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3004141570 0x7f30040962b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:57618/0 (socket says 172.21.15.115:57618) 2023-09-29T23:05:16.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f3008eda700 1 -- 172.21.15.115:0/459229830 learned_addr learned my addr 172.21.15.115:0/459229830 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:16.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.797+0000 7f30096db700 1 --2- 172.21.15.115:0/459229830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30040680b0 0x7f3004094ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.801+0000 7f3008eda700 1 -- 172.21.15.115:0/459229830 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3004141570 msgr2=0x7f30040962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.801+0000 7f3008eda700 1 --2- 172.21.15.115:0/459229830 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3004141570 0x7f30040962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.801+0000 7f3008eda700 1 -- 172.21.15.115:0/459229830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30040680b0 msgr2=0x7f3004094ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:16.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.801+0000 7f3008eda700 1 --2- 172.21.15.115:0/459229830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30040680b0 0x7f3004094ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:16.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.801+0000 7f3008eda700 1 -- 172.21.15.115:0/459229830 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc009ae0 con 0x7f3004068480 2023-09-29T23:05:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.801+0000 7f3008eda700 1 --2- 172.21.15.115:0/459229830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068480 0x7f3004097c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400c590 tx=0x7f2ff4007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.801+0000 7f2ff97fa700 1 -- 172.21.15.115:0/459229830 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4011590 con 0x7f3004068480 2023-09-29T23:05:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.801+0000 7f2ff97fa700 1 -- 172.21.15.115:0/459229830 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff4011730 con 0x7f3004068480 2023-09-29T23:05:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.801+0000 7f300b93f700 1 -- 172.21.15.115:0/459229830 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3004097680 con 0x7f3004068480 2023-09-29T23:05:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.801+0000 7f2ff97fa700 1 -- 172.21.15.115:0/459229830 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4011af0 con 0x7f3004068480 2023-09-29T23:05:16.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.801+0000 7f300b93f700 1 -- 172.21.15.115:0/459229830 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300406f260 con 0x7f3004068480 2023-09-29T23:05:16.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.801+0000 7f300b93f700 1 -- 172.21.15.115:0/459229830 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3004070990 con 0x7f3004068480 2023-09-29T23:05:16.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.805+0000 7f2ff97fa700 1 -- 172.21.15.115:0/459229830 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f2ff401c460 con 0x7f3004068480 2023-09-29T23:05:16.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.805+0000 7f2ff97fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:16.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.805+0000 7f2ff97fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:16.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.805+0000 7f2ff97fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:16.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.805+0000 7f2ff97fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:16.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.805+0000 7f2ff97fa700 1 --2- 172.21.15.115:0/459229830 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2fe808e8b0 0x7f2fe8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:16.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.805+0000 7f2ff97fa700 1 -- 172.21.15.115:0/459229830 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f2ff40b45b0 con 0x7f3004068480 2023-09-29T23:05:16.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.805+0000 7f30096db700 1 --2- 172.21.15.115:0/459229830 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2fe808e8b0 0x7f2fe8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:16.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.805+0000 7f30096db700 1 --2- 172.21.15.115:0/459229830 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2fe808e8b0 0x7f2fe8090d60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009a60 tx=0x7f2ffc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:16.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:16.813+0000 7f2ff97fa700 1 -- 172.21.15.115:0/459229830 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2ff4084f40 con 0x7f3004068480 2023-09-29T23:05:17.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.005+0000 7f300b93f700 1 -- 172.21.15.115:0/459229830 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f30040b18e0 con 0x7f3004068480 2023-09-29T23:05:17.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.005+0000 7f2ff97fa700 1 -- 172.21.15.115:0/459229830 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2ff4088560 con 0x7f3004068480 2023-09-29T23:05:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:17.008 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:05:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.009+0000 7f300b93f700 10 mgrc shutdown 2023-09-29T23:05:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.009+0000 7f300b93f700 1 -- 172.21.15.115:0/459229830 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2fe808e8b0 msgr2=0x7f2fe8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.009+0000 7f300b93f700 1 --2- 172.21.15.115:0/459229830 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2fe808e8b0 0x7f2fe8090d60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009a60 tx=0x7f2ffc017000 comp rx=0 tx=0).stop 2023-09-29T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.009+0000 7f300b93f700 1 -- 172.21.15.115:0/459229830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068480 msgr2=0x7f3004097c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.009+0000 7f300b93f700 1 --2- 172.21.15.115:0/459229830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068480 0x7f3004097c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400c590 tx=0x7f2ff4007f30 comp rx=0 tx=0).stop 2023-09-29T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.009+0000 7f300b93f700 1 -- 172.21.15.115:0/459229830 shutdown_connections 2023-09-29T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.009+0000 7f300b93f700 1 --2- 172.21.15.115:0/459229830 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3004141570 0x7f30040962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.009+0000 7f300b93f700 1 --2- 172.21.15.115:0/459229830 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2fe808e8b0 0x7f2fe8090d60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.009+0000 7f300b93f700 1 --2- 172.21.15.115:0/459229830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068480 0x7f3004097c20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.009+0000 7f300b93f700 1 --2- 172.21.15.115:0/459229830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30040680b0 0x7f3004094ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.009+0000 7f300b93f700 1 -- 172.21.15.115:0/459229830 >> 172.21.15.115:0/459229830 conn(0x7f30040695c0 msgr2=0x7f300413cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.009+0000 7f300b93f700 1 -- 172.21.15.115:0/459229830 shutdown_connections 2023-09-29T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:17.009+0000 7f300b93f700 1 -- 172.21.15.115:0/459229830 wait complete. 2023-09-29T23:05:20.028 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:05:20.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.133+0000 7fdd2aafd700 1 Processor -- start 2023-09-29T23:05:20.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.133+0000 7fdd2aafd700 1 -- start start 2023-09-29T23:05:20.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.133+0000 7fdd2aafd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdd2409fc60 0x7fdd240a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:20.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.133+0000 7fdd2aafd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdd2413fe10 0x7fdd24140250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:20.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.133+0000 7fdd2aafd700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd240a0030 con 0x7fdd24142e50 2023-09-29T23:05:20.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.133+0000 7fdd2aafd700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd240a1ac0 con 0x7fdd2409fc60 2023-09-29T23:05:20.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.133+0000 7fdd2aafd700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2413fb70 con 0x7fdd2413fe10 2023-09-29T23:05:20.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.133+0000 7fdd29afb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdd2409fc60 0x7fdd240a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:20.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.133+0000 7fdd29afb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdd2409fc60 0x7fdd240a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37504/0 (socket says 172.21.15.115:37504) 2023-09-29T23:05:20.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.133+0000 7fdd29afb700 1 -- 172.21.15.115:0/3237958581 learned_addr learned my addr 172.21.15.115:0/3237958581 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:20.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2a2fc700 1 --2- 172.21.15.115:0/3237958581 >> v2:172.21.15.156:3300/0 conn(0x7fdd2413fe10 0x7fdd24140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:20.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd29afb700 1 -- 172.21.15.115:0/3237958581 >> v2:172.21.15.156:3300/0 conn(0x7fdd2413fe10 msgr2=0x7fdd24140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:20.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd29afb700 1 --2- 172.21.15.115:0/3237958581 >> v2:172.21.15.156:3300/0 conn(0x7fdd2413fe10 0x7fdd24140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:20.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd29afb700 1 -- 172.21.15.115:0/3237958581 >> v1:172.21.15.156:6789/0 conn(0x7fdd24142e50 legacy=0x7fdd241434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:20.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd29afb700 1 -- 172.21.15.115:0/3237958581 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2413f8d0 con 0x7fdd2409fc60 2023-09-29T23:05:20.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2a2fc700 1 --2- 172.21.15.115:0/3237958581 >> v2:172.21.15.156:3300/0 conn(0x7fdd2413fe10 0x7fdd24140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:05:20.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd29afb700 1 --2- 172.21.15.115:0/3237958581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2409fc60 0x7fdd240a1580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdd2406f800 tx=0x7fdd20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ee51a95eb0c57a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:20.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd28af9700 1 -- 172.21.15.115:0/3237958581 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000b820 con 0x7fdd2409fc60 2023-09-29T23:05:20.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd28af9700 1 -- 172.21.15.115:0/3237958581 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2000b980 con 0x7fdd2409fc60 2023-09-29T23:05:20.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd28af9700 1 -- 172.21.15.115:0/3237958581 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000bd20 con 0x7fdd2409fc60 2023-09-29T23:05:20.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 -- 172.21.15.115:0/3237958581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2409fc60 msgr2=0x7fdd240a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:20.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 --2- 172.21.15.115:0/3237958581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2409fc60 0x7fdd240a1580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdd2406f800 tx=0x7fdd20009250 comp rx=0 tx=0).stop 2023-09-29T23:05:20.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 -- 172.21.15.115:0/3237958581 shutdown_connections 2023-09-29T23:05:20.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 --2- 172.21.15.115:0/3237958581 >> v2:172.21.15.156:3300/0 conn(0x7fdd2413fe10 0x7fdd24140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:20.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 --2- 172.21.15.115:0/3237958581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2409fc60 0x7fdd240a1580 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:20.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 -- 172.21.15.115:0/3237958581 >> 172.21.15.115:0/3237958581 conn(0x7fdd240b6c10 msgr2=0x7fdd24067bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:20.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 -- 172.21.15.115:0/3237958581 shutdown_connections 2023-09-29T23:05:20.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 -- 172.21.15.115:0/3237958581 wait complete. 2023-09-29T23:05:20.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 Processor -- start 2023-09-29T23:05:20.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 -- start start 2023-09-29T23:05:20.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd2409fc60 0x7fdd2413e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:20.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2413fe10 0x7fdd240ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:20.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd24142e50 0x7fdd240af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:20.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd24152bc0 con 0x7fdd2413fe10 2023-09-29T23:05:20.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2414f4e0 con 0x7fdd2409fc60 2023-09-29T23:05:20.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd2aafd700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2413e820 con 0x7fdd24142e50 2023-09-29T23:05:20.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd292fa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2413fe10 0x7fdd240ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:20.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd292fa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2413fe10 0x7fdd240ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37516/0 (socket says 172.21.15.115:37516) 2023-09-29T23:05:20.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.137+0000 7fdd292fa700 1 -- 172.21.15.115:0/680850377 learned_addr learned my addr 172.21.15.115:0/680850377 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:20.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd29afb700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd2409fc60 0x7fdd2413e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:20.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd2a2fc700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd24142e50 0x7fdd240af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:20.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd292fa700 1 -- 172.21.15.115:0/680850377 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd24142e50 msgr2=0x7fdd240af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:20.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd292fa700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd24142e50 0x7fdd240af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:20.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd292fa700 1 -- 172.21.15.115:0/680850377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd2409fc60 msgr2=0x7fdd2413e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:20.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd292fa700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd2409fc60 0x7fdd2413e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:20.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd292fa700 1 -- 172.21.15.115:0/680850377 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd200094f0 con 0x7fdd2413fe10 2023-09-29T23:05:20.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd292fa700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2413fe10 0x7fdd240ae220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400b610 tx=0x7fdd14009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:20.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd19ffb700 1 -- 172.21.15.115:0/680850377 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400f510 con 0x7fdd2413fe10 2023-09-29T23:05:20.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd19ffb700 1 -- 172.21.15.115:0/680850377 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1400f670 con 0x7fdd2413fe10 2023-09-29T23:05:20.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd2aafd700 1 -- 172.21.15.115:0/680850377 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd24152db0 con 0x7fdd2413fe10 2023-09-29T23:05:20.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd19ffb700 1 -- 172.21.15.115:0/680850377 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400fa30 con 0x7fdd2413fe10 2023-09-29T23:05:20.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd2aafd700 1 -- 172.21.15.115:0/680850377 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd240a5bb0 con 0x7fdd2413fe10 2023-09-29T23:05:20.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd2aafd700 1 -- 172.21.15.115:0/680850377 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2404be00 con 0x7fdd2413fe10 2023-09-29T23:05:20.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.141+0000 7fdd19ffb700 1 -- 172.21.15.115:0/680850377 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fdd14024430 con 0x7fdd2413fe10 2023-09-29T23:05:20.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.145+0000 7fdd19ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:20.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.145+0000 7fdd19ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:20.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.145+0000 7fdd19ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:20.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.145+0000 7fdd19ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:20.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.145+0000 7fdd19ffb700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fdd0808e8b0 0x7fdd08090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:20.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.145+0000 7fdd19ffb700 1 -- 172.21.15.115:0/680850377 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fdd140b4e30 con 0x7fdd2413fe10 2023-09-29T23:05:20.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.145+0000 7fdd29afb700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fdd0808e8b0 0x7fdd08090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:20.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.145+0000 7fdd29afb700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fdd0808e8b0 0x7fdd08090d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd2406f800 tx=0x7fdd20016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:20.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.145+0000 7fdd19ffb700 1 -- 172.21.15.115:0/680850377 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdd14085860 con 0x7fdd2413fe10 2023-09-29T23:05:20.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.337+0000 7fdd2aafd700 1 -- 172.21.15.115:0/680850377 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdd240a7c80 con 0x7fdd2413fe10 2023-09-29T23:05:20.339 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.337+0000 7fdd19ffb700 1 -- 172.21.15.115:0/680850377 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fdd14088e80 con 0x7fdd2413fe10 2023-09-29T23:05:20.339 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:20.340 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:05:20.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.337+0000 7fdd2aafd700 10 mgrc shutdown 2023-09-29T23:05:20.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.341+0000 7fdd2aafd700 1 -- 172.21.15.115:0/680850377 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fdd0808e8b0 msgr2=0x7fdd08090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:20.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.341+0000 7fdd2aafd700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fdd0808e8b0 0x7fdd08090d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd2406f800 tx=0x7fdd20016000 comp rx=0 tx=0).stop 2023-09-29T23:05:20.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.341+0000 7fdd2aafd700 1 -- 172.21.15.115:0/680850377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2413fe10 msgr2=0x7fdd240ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:20.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.341+0000 7fdd2aafd700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2413fe10 0x7fdd240ae220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400b610 tx=0x7fdd14009120 comp rx=0 tx=0).stop 2023-09-29T23:05:20.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.341+0000 7fdd2aafd700 1 -- 172.21.15.115:0/680850377 shutdown_connections 2023-09-29T23:05:20.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.341+0000 7fdd2aafd700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd24142e50 0x7fdd240af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:20.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.341+0000 7fdd2aafd700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fdd0808e8b0 0x7fdd08090d60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:20.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.341+0000 7fdd2aafd700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2413fe10 0x7fdd240ae220 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:20.342 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.341+0000 7fdd2aafd700 1 --2- 172.21.15.115:0/680850377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd2409fc60 0x7fdd2413e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:20.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.341+0000 7fdd2aafd700 1 -- 172.21.15.115:0/680850377 >> 172.21.15.115:0/680850377 conn(0x7fdd240b6c10 msgr2=0x7fdd241426d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:20.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.341+0000 7fdd2aafd700 1 -- 172.21.15.115:0/680850377 shutdown_connections 2023-09-29T23:05:20.343 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:20.341+0000 7fdd2aafd700 1 -- 172.21.15.115:0/680850377 wait complete. 2023-09-29T23:05:23.353 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:05:23.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.461+0000 7f22d16c8700 1 Processor -- start 2023-09-29T23:05:23.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.461+0000 7f22d16c8700 1 -- start start 2023-09-29T23:05:23.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.461+0000 7f22d16c8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22cc09c190 0x7f22cc0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:23.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.461+0000 7f22d16c8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f22cc0a5d60 0x7f22cc06a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:23.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.461+0000 7f22d16c8700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc0a5900 con 0x7f22cc13fbd0 2023-09-29T23:05:23.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.461+0000 7f22d16c8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc09c560 con 0x7f22cc09c190 2023-09-29T23:05:23.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.461+0000 7f22d16c8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc140180 con 0x7f22cc0a5d60 2023-09-29T23:05:23.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22cbfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22cc09c190 0x7f22cc0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:23.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22cbfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22cc09c190 0x7f22cc0a53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37526/0 (socket says 172.21.15.115:37526) 2023-09-29T23:05:23.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22cbfff700 1 -- 172.21.15.115:0/1046892087 learned_addr learned my addr 172.21.15.115:0/1046892087 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:23.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22c37fe700 1 --2- 172.21.15.115:0/1046892087 >> v2:172.21.15.156:3300/0 conn(0x7f22cc0a5d60 0x7f22cc06a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:23.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22cbfff700 1 -- 172.21.15.115:0/1046892087 >> v2:172.21.15.156:3300/0 conn(0x7f22cc0a5d60 msgr2=0x7f22cc06a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:23.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22cbfff700 1 --2- 172.21.15.115:0/1046892087 >> v2:172.21.15.156:3300/0 conn(0x7f22cc0a5d60 0x7f22cc06a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:23.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22cbfff700 1 -- 172.21.15.115:0/1046892087 >> v1:172.21.15.156:6789/0 conn(0x7f22cc13fbd0 legacy=0x7f22cc06d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:23.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22cbfff700 1 -- 172.21.15.115:0/1046892087 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc140420 con 0x7f22cc09c190 2023-09-29T23:05:23.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22cbfff700 1 --2- 172.21.15.115:0/1046892087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22cc09c190 0x7f22cc0a53c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f22cc06fc10 tx=0x7f22bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981efe9955408c74 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:23.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22cb7fe700 1 -- 172.21.15.115:0/1046892087 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc009e70 con 0x7f22cc09c190 2023-09-29T23:05:23.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22cb7fe700 1 -- 172.21.15.115:0/1046892087 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc00b860 con 0x7f22cc09c190 2023-09-29T23:05:23.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22cb7fe700 1 -- 172.21.15.115:0/1046892087 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00bc00 con 0x7f22cc09c190 2023-09-29T23:05:23.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22d16c8700 1 -- 172.21.15.115:0/1046892087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22cc09c190 msgr2=0x7f22cc0a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:23.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22d16c8700 1 --2- 172.21.15.115:0/1046892087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22cc09c190 0x7f22cc0a53c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f22cc06fc10 tx=0x7f22bc009250 comp rx=0 tx=0).stop 2023-09-29T23:05:23.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22d16c8700 1 -- 172.21.15.115:0/1046892087 shutdown_connections 2023-09-29T23:05:23.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22d16c8700 1 --2- 172.21.15.115:0/1046892087 >> v2:172.21.15.156:3300/0 conn(0x7f22cc0a5d60 0x7f22cc06a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:23.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22d16c8700 1 --2- 172.21.15.115:0/1046892087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22cc09c190 0x7f22cc0a53c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:23.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22d16c8700 1 -- 172.21.15.115:0/1046892087 >> 172.21.15.115:0/1046892087 conn(0x7f22cc068a40 msgr2=0x7f22cc068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:23.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22d16c8700 1 -- 172.21.15.115:0/1046892087 shutdown_connections 2023-09-29T23:05:23.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22d16c8700 1 -- 172.21.15.115:0/1046892087 wait complete. 2023-09-29T23:05:23.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.465+0000 7f22d16c8700 1 Processor -- start 2023-09-29T23:05:23.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d16c8700 1 -- start start 2023-09-29T23:05:23.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d16c8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22cc09c190 0x7f22cc13a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:23.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d16c8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22cc0a5d60 0x7f22cc09efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:23.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d16c8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22cc13fbd0 0x7f22cc09d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:23.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d16c8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc14e6e0 con 0x7f22cc13fbd0 2023-09-29T23:05:23.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d16c8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc09e7d0 con 0x7f22cc0a5d60 2023-09-29T23:05:23.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d16c8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc09eab0 con 0x7f22cc09c190 2023-09-29T23:05:23.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d0ec7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22cc13fbd0 0x7f22cc09d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:23.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22cbfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22cc09c190 0x7f22cc13a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:23.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d0ec7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22cc13fbd0 0x7f22cc09d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37540/0 (socket says 172.21.15.115:37540) 2023-09-29T23:05:23.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d0ec7700 1 -- 172.21.15.115:0/932544329 learned_addr learned my addr 172.21.15.115:0/932544329 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:23.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22c37fe700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22cc0a5d60 0x7f22cc09efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:23.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d0ec7700 1 -- 172.21.15.115:0/932544329 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22cc09c190 msgr2=0x7f22cc13a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:23.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d0ec7700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22cc09c190 0x7f22cc13a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:23.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d0ec7700 1 -- 172.21.15.115:0/932544329 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22cc0a5d60 msgr2=0x7f22cc09efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:23.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d0ec7700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22cc0a5d60 0x7f22cc09efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:23.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d0ec7700 1 -- 172.21.15.115:0/932544329 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0094f0 con 0x7f22cc13fbd0 2023-09-29T23:05:23.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22c37fe700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22cc0a5d60 0x7f22cc09efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:23.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d0ec7700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22cc13fbd0 0x7f22cc09d7f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22c400c7f0 tx=0x7f22c4001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:23.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22c8ff9700 1 -- 172.21.15.115:0/932544329 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c4012630 con 0x7f22cc13fbd0 2023-09-29T23:05:23.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22c8ff9700 1 -- 172.21.15.115:0/932544329 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c4012790 con 0x7f22cc13fbd0 2023-09-29T23:05:23.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d16c8700 1 -- 172.21.15.115:0/932544329 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc14e910 con 0x7f22cc13fbd0 2023-09-29T23:05:23.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22c8ff9700 1 -- 172.21.15.115:0/932544329 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c4012b50 con 0x7f22cc13fbd0 2023-09-29T23:05:23.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.469+0000 7f22d16c8700 1 -- 172.21.15.115:0/932544329 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc1416e0 con 0x7f22cc13fbd0 2023-09-29T23:05:23.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.473+0000 7f22d16c8700 1 -- 172.21.15.115:0/932544329 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc04be00 con 0x7f22cc13fbd0 2023-09-29T23:05:23.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.473+0000 7f22c8ff9700 1 -- 172.21.15.115:0/932544329 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f22c4003030 con 0x7f22cc13fbd0 2023-09-29T23:05:23.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.473+0000 7f22c8ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:23.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.473+0000 7f22c8ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:23.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.473+0000 7f22c8ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:23.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.473+0000 7f22c8ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:23.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.473+0000 7f22c8ff9700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f22b008e830 0x7f22b0090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:23.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.477+0000 7f22c8ff9700 1 -- 172.21.15.115:0/932544329 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f22c40b4c40 con 0x7f22cc13fbd0 2023-09-29T23:05:23.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.477+0000 7f22cbfff700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f22b008e830 0x7f22b0090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:23.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.477+0000 7f22cbfff700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f22b008e830 0x7f22b0090ce0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22cc06fc10 tx=0x7f22bc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:23.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.481+0000 7f22c8ff9700 1 -- 172.21.15.115:0/932544329 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f22c4085700 con 0x7f22cc13fbd0 2023-09-29T23:05:23.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.681+0000 7f22d16c8700 1 -- 172.21.15.115:0/932544329 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f22cc06ef20 con 0x7f22cc13fbd0 2023-09-29T23:05:23.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.681+0000 7f22c8ff9700 1 -- 172.21.15.115:0/932544329 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f22c4088d20 con 0x7f22cc13fbd0 2023-09-29T23:05:23.685 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:23.685 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:05:23.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.685+0000 7f22d16c8700 10 mgrc shutdown 2023-09-29T23:05:23.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.685+0000 7f22d16c8700 1 -- 172.21.15.115:0/932544329 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f22b008e830 msgr2=0x7f22b0090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:23.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.685+0000 7f22d16c8700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f22b008e830 0x7f22b0090ce0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22cc06fc10 tx=0x7f22bc017000 comp rx=0 tx=0).stop 2023-09-29T23:05:23.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.685+0000 7f22d16c8700 1 -- 172.21.15.115:0/932544329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22cc13fbd0 msgr2=0x7f22cc09d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:23.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.685+0000 7f22d16c8700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22cc13fbd0 0x7f22cc09d7f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22c400c7f0 tx=0x7f22c4001630 comp rx=0 tx=0).stop 2023-09-29T23:05:23.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.685+0000 7f22d16c8700 1 -- 172.21.15.115:0/932544329 shutdown_connections 2023-09-29T23:05:23.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.685+0000 7f22d16c8700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f22b008e830 0x7f22b0090ce0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:23.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.685+0000 7f22d16c8700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22cc13fbd0 0x7f22cc09d7f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:23.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.685+0000 7f22d16c8700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22cc0a5d60 0x7f22cc09efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:23.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.685+0000 7f22d16c8700 1 --2- 172.21.15.115:0/932544329 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22cc09c190 0x7f22cc13a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:23.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.685+0000 7f22d16c8700 1 -- 172.21.15.115:0/932544329 >> 172.21.15.115:0/932544329 conn(0x7f22cc068a40 msgr2=0x7f22cc06e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:23.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.685+0000 7f22d16c8700 1 -- 172.21.15.115:0/932544329 shutdown_connections 2023-09-29T23:05:23.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:23.685+0000 7f22d16c8700 1 -- 172.21.15.115:0/932544329 wait complete. 2023-09-29T23:05:26.705 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:05:26.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a3524700 1 Processor -- start 2023-09-29T23:05:26.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a3524700 1 -- start start 2023-09-29T23:05:26.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a3524700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe99c13fbd0 0x7fe99c0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:26.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a3524700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe99c0a5900 con 0x7fe99c0a5d60 2023-09-29T23:05:26.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a3524700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe99c140180 con 0x7fe99c09c190 2023-09-29T23:05:26.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a3524700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99c09c560 con 0x7fe99c13fbd0 2023-09-29T23:05:26.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a1d21700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe99c0a5d60 0x7fe99c144f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47620/0 (socket says 172.21.15.115:47620) 2023-09-29T23:05:26.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a1d21700 1 -- 172.21.15.115:0/430896023 learned_addr learned my addr 172.21.15.115:0/430896023 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:26.819 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a2d23700 1 --2- 172.21.15.115:0/430896023 >> v2:172.21.15.156:3300/0 conn(0x7fe99c13fbd0 0x7fe99c0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:26.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a1520700 1 -- 172.21.15.115:0/430896023 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945558691 0 0) 0x7fe98c001110 con 0x7fe99c0a5d60 2023-09-29T23:05:26.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a1520700 1 -- 172.21.15.115:0/430896023 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe988003570 con 0x7fe99c0a5d60 2023-09-29T23:05:26.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a2d23700 1 -- 172.21.15.115:0/430896023 >> v1:172.21.15.156:6789/0 conn(0x7fe99c09c190 legacy=0x7fe99c06a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:26.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a2d23700 1 -- 172.21.15.115:0/430896023 >> v1:172.21.15.115:6789/0 conn(0x7fe99c0a5d60 legacy=0x7fe99c144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:26.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a2d23700 1 -- 172.21.15.115:0/430896023 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c140420 con 0x7fe99c13fbd0 2023-09-29T23:05:26.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a2d23700 1 --2- 172.21.15.115:0/430896023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c13fbd0 0x7fe99c0a53c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe994009e60 tx=0x7fe994009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c5441860de343ea server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:26.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a1520700 1 -- 172.21.15.115:0/430896023 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99400e070 con 0x7fe99c13fbd0 2023-09-29T23:05:26.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a1520700 1 -- 172.21.15.115:0/430896023 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99400bb60 con 0x7fe99c13fbd0 2023-09-29T23:05:26.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a1520700 1 -- 172.21.15.115:0/430896023 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994012430 con 0x7fe99c13fbd0 2023-09-29T23:05:26.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a3524700 1 -- 172.21.15.115:0/430896023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c13fbd0 msgr2=0x7fe99c0a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:26.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a3524700 1 --2- 172.21.15.115:0/430896023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c13fbd0 0x7fe99c0a53c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe994009e60 tx=0x7fe994009780 comp rx=0 tx=0).stop 2023-09-29T23:05:26.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a3524700 1 -- 172.21.15.115:0/430896023 shutdown_connections 2023-09-29T23:05:26.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a3524700 1 --2- 172.21.15.115:0/430896023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c13fbd0 0x7fe99c0a53c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:26.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a3524700 1 -- 172.21.15.115:0/430896023 >> 172.21.15.115:0/430896023 conn(0x7fe99c068a40 msgr2=0x7fe99c068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:26.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a3524700 1 -- 172.21.15.115:0/430896023 shutdown_connections 2023-09-29T23:05:26.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.817+0000 7fe9a3524700 1 -- 172.21.15.115:0/430896023 wait complete. 2023-09-29T23:05:26.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a3524700 1 Processor -- start 2023-09-29T23:05:26.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a3524700 1 -- start start 2023-09-29T23:05:26.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a3524700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe99c09c190 0x7fe99c13bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:26.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a3524700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c0a5d60 0x7fe99c139e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:26.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a3524700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe99c13fbd0 0x7fe99c13a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:26.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a3524700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c13a8f0 con 0x7fe99c13fbd0 2023-09-29T23:05:26.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a3524700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c13c390 con 0x7fe99c0a5d60 2023-09-29T23:05:26.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a3524700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c0a5450 con 0x7fe99c09c190 2023-09-29T23:05:26.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a2d23700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe99c13fbd0 0x7fe99c13a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:26.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a2d23700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe99c13fbd0 0x7fe99c13a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55166/0 (socket says 172.21.15.115:55166) 2023-09-29T23:05:26.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a2d23700 1 -- 172.21.15.115:0/1264861651 learned_addr learned my addr 172.21.15.115:0/1264861651 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:26.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a2522700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe99c09c190 0x7fe99c13bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:26.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a1d21700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c0a5d60 0x7fe99c139e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:26.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a2d23700 1 -- 172.21.15.115:0/1264861651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe99c09c190 msgr2=0x7fe99c13bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:26.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a2d23700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe99c09c190 0x7fe99c13bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:26.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a2d23700 1 -- 172.21.15.115:0/1264861651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c0a5d60 msgr2=0x7fe99c139e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:26.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a2d23700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c0a5d60 0x7fe99c139e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:26.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a2d23700 1 -- 172.21.15.115:0/1264861651 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe994009a20 con 0x7fe99c13fbd0 2023-09-29T23:05:26.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a2522700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe99c09c190 0x7fe99c13bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:26.825 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a2d23700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe99c13fbd0 0x7fe99c13a3b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe99c06ae00 tx=0x7fe994019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:26.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9927fc700 1 -- 172.21.15.115:0/1264861651 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994027470 con 0x7fe99c13fbd0 2023-09-29T23:05:26.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a3524700 1 -- 172.21.15.115:0/1264861651 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c13b1a0 con 0x7fe99c13fbd0 2023-09-29T23:05:26.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9a3524700 1 -- 172.21.15.115:0/1264861651 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c13c080 con 0x7fe99c13fbd0 2023-09-29T23:05:26.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9927fc700 1 -- 172.21.15.115:0/1264861651 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9940277e0 con 0x7fe99c13fbd0 2023-09-29T23:05:26.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.821+0000 7fe9927fc700 1 -- 172.21.15.115:0/1264861651 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994027950 con 0x7fe99c13fbd0 2023-09-29T23:05:26.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.825+0000 7fe9a3524700 1 -- 172.21.15.115:0/1264861651 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9840050b0 con 0x7fe99c13fbd0 2023-09-29T23:05:26.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.825+0000 7fe9927fc700 1 -- 172.21.15.115:0/1264861651 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fe994024070 con 0x7fe99c13fbd0 2023-09-29T23:05:26.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.825+0000 7fe9927fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:26.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.825+0000 7fe9927fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:26.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.825+0000 7fe9927fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:26.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.825+0000 7fe9927fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:26.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.825+0000 7fe9927fc700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe98008e830 0x7fe980090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:26.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.825+0000 7fe9927fc700 1 -- 172.21.15.115:0/1264861651 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fe9940b7110 con 0x7fe99c13fbd0 2023-09-29T23:05:26.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.825+0000 7fe9a2522700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe98008e830 0x7fe980090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:26.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.825+0000 7fe9a2522700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe98008e830 0x7fe980090ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe998007fd0 tx=0x7fe998009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:26.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:26.833+0000 7fe9927fc700 1 -- 172.21.15.115:0/1264861651 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe994087bd0 con 0x7fe99c13fbd0 2023-09-29T23:05:27.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.029+0000 7fe9a3524700 1 -- 172.21.15.115:0/1264861651 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe984005630 con 0x7fe99c13fbd0 2023-09-29T23:05:27.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.029+0000 7fe9927fc700 1 -- 172.21.15.115:0/1264861651 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fe99408b1f0 con 0x7fe99c13fbd0 2023-09-29T23:05:27.032 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:27.032 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:05:27.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.033+0000 7fe9a3524700 10 mgrc shutdown 2023-09-29T23:05:27.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.033+0000 7fe9a3524700 1 -- 172.21.15.115:0/1264861651 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe98008e830 msgr2=0x7fe980090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:27.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.033+0000 7fe9a3524700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe98008e830 0x7fe980090ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe998007fd0 tx=0x7fe998009040 comp rx=0 tx=0).stop 2023-09-29T23:05:27.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.033+0000 7fe9a3524700 1 -- 172.21.15.115:0/1264861651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe99c13fbd0 msgr2=0x7fe99c13a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:27.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.033+0000 7fe9a3524700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe99c13fbd0 0x7fe99c13a3b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe99c06ae00 tx=0x7fe994019000 comp rx=0 tx=0).stop 2023-09-29T23:05:27.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.033+0000 7fe9a3524700 1 -- 172.21.15.115:0/1264861651 shutdown_connections 2023-09-29T23:05:27.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.033+0000 7fe9a3524700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe98008e830 0x7fe980090ce0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:27.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.033+0000 7fe9a3524700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe99c13fbd0 0x7fe99c13a3b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:27.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.033+0000 7fe9a3524700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe99c0a5d60 0x7fe99c139e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:27.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.033+0000 7fe9a3524700 1 --2- 172.21.15.115:0/1264861651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe99c09c190 0x7fe99c13bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:27.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.033+0000 7fe9a3524700 1 -- 172.21.15.115:0/1264861651 >> 172.21.15.115:0/1264861651 conn(0x7fe99c068a40 msgr2=0x7fe99c0b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:27.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.033+0000 7fe9a3524700 1 -- 172.21.15.115:0/1264861651 shutdown_connections 2023-09-29T23:05:27.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:27.033+0000 7fe9a3524700 1 -- 172.21.15.115:0/1264861651 wait complete. 2023-09-29T23:05:30.047 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:05:30.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf87932700 1 Processor -- start 2023-09-29T23:05:30.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf87932700 1 -- start start 2023-09-29T23:05:30.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf87932700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbf800680b0 0x7fbf8009f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:30.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf87932700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbf80141570 0x7fbf801419f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:30.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf87932700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8009fd00 con 0x7fbf80068480 2023-09-29T23:05:30.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf87932700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8009b870 con 0x7fbf80141570 2023-09-29T23:05:30.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf87932700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf80140ff0 con 0x7fbf800680b0 2023-09-29T23:05:30.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf85ecf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbf80141570 0x7fbf801419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:30.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf85ecf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbf80141570 0x7fbf801419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55182/0 (socket says 172.21.15.115:55182) 2023-09-29T23:05:30.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf85ecf700 1 -- 172.21.15.115:0/4012389397 learned_addr learned my addr 172.21.15.115:0/4012389397 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:30.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf856ce700 1 --2- 172.21.15.115:0/4012389397 >> v2:172.21.15.156:3300/0 conn(0x7fbf800680b0 0x7fbf8009f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:30.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf85ecf700 1 -- 172.21.15.115:0/4012389397 >> v2:172.21.15.156:3300/0 conn(0x7fbf800680b0 msgr2=0x7fbf8009f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:30.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf85ecf700 1 --2- 172.21.15.115:0/4012389397 >> v2:172.21.15.156:3300/0 conn(0x7fbf800680b0 0x7fbf8009f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:30.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf85ecf700 1 -- 172.21.15.115:0/4012389397 >> v1:172.21.15.156:6789/0 conn(0x7fbf80068480 legacy=0x7fbf8009b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:30.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf85ecf700 1 -- 172.21.15.115:0/4012389397 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf801412b0 con 0x7fbf80141570 2023-09-29T23:05:30.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf85ecf700 1 --2- 172.21.15.115:0/4012389397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf80141570 0x7fbf801419f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbf8006aa50 tx=0x7fbf78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab16020dba7f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:30.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf77fff700 1 -- 172.21.15.115:0/4012389397 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7800b860 con 0x7fbf80141570 2023-09-29T23:05:30.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf77fff700 1 -- 172.21.15.115:0/4012389397 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7800b9c0 con 0x7fbf80141570 2023-09-29T23:05:30.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.161+0000 7fbf77fff700 1 -- 172.21.15.115:0/4012389397 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7800bd80 con 0x7fbf80141570 2023-09-29T23:05:30.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.165+0000 7fbf87932700 1 -- 172.21.15.115:0/4012389397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf80141570 msgr2=0x7fbf801419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:30.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.165+0000 7fbf87932700 1 --2- 172.21.15.115:0/4012389397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf80141570 0x7fbf801419f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbf8006aa50 tx=0x7fbf78009250 comp rx=0 tx=0).stop 2023-09-29T23:05:30.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.165+0000 7fbf87932700 1 -- 172.21.15.115:0/4012389397 shutdown_connections 2023-09-29T23:05:30.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.165+0000 7fbf87932700 1 --2- 172.21.15.115:0/4012389397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf80141570 0x7fbf801419f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:30.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.165+0000 7fbf87932700 1 --2- 172.21.15.115:0/4012389397 >> v2:172.21.15.156:3300/0 conn(0x7fbf800680b0 0x7fbf8009f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:30.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.165+0000 7fbf87932700 1 -- 172.21.15.115:0/4012389397 >> 172.21.15.115:0/4012389397 conn(0x7fbf800695c0 msgr2=0x7fbf800699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:30.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.165+0000 7fbf87932700 1 -- 172.21.15.115:0/4012389397 shutdown_connections 2023-09-29T23:05:30.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.165+0000 7fbf87932700 1 -- 172.21.15.115:0/4012389397 wait complete. 2023-09-29T23:05:30.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.165+0000 7fbf87932700 1 Processor -- start 2023-09-29T23:05:30.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.165+0000 7fbf87932700 1 -- start start 2023-09-29T23:05:30.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf87932700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf800680b0 0x7fbf801444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:30.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf87932700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf80068480 0x7fbf8006e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:30.170 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf87932700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf80141570 0x7fbf80099c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:30.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf87932700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8006f2d0 con 0x7fbf80068480 2023-09-29T23:05:30.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf87932700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf800a2310 con 0x7fbf800680b0 2023-09-29T23:05:30.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf87932700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf800a25d0 con 0x7fbf80141570 2023-09-29T23:05:30.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf84ecd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf80068480 0x7fbf8006e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:30.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf85ecf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf80141570 0x7fbf80099c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:30.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf856ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf800680b0 0x7fbf801444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:30.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf856ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf800680b0 0x7fbf801444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.115:56430/0 (socket says 172.21.15.115:56430) 2023-09-29T23:05:30.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf856ce700 1 -- 172.21.15.115:0/2857228184 learned_addr learned my addr 172.21.15.115:0/2857228184 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:30.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf84ecd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf80068480 0x7fbf8006e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55198/0 (socket says 172.21.15.115:55198) 2023-09-29T23:05:30.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf85ecf700 1 -- 172.21.15.115:0/2857228184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf800680b0 msgr2=0x7fbf801444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:30.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf85ecf700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf800680b0 0x7fbf801444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:30.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf85ecf700 1 -- 172.21.15.115:0/2857228184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf80068480 msgr2=0x7fbf8006e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:30.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf85ecf700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf80068480 0x7fbf8006e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:30.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf85ecf700 1 -- 172.21.15.115:0/2857228184 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780094f0 con 0x7fbf80141570 2023-09-29T23:05:30.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf856ce700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf800680b0 0x7fbf801444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:30.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf84ecd700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf80068480 0x7fbf8006e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:30.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf85ecf700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf80141570 0x7fbf80099c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf8006b2b0 tx=0x7fbf78017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:30.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf757fa700 1 -- 172.21.15.115:0/2857228184 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7801f070 con 0x7fbf80141570 2023-09-29T23:05:30.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf757fa700 1 -- 172.21.15.115:0/2857228184 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7801a630 con 0x7fbf80141570 2023-09-29T23:05:30.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf87932700 1 -- 172.21.15.115:0/2857228184 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf800a3720 con 0x7fbf80141570 2023-09-29T23:05:30.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf757fa700 1 -- 172.21.15.115:0/2857228184 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7800b860 con 0x7fbf80141570 2023-09-29T23:05:30.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.169+0000 7fbf87932700 1 -- 172.21.15.115:0/2857228184 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf801449e0 con 0x7fbf80141570 2023-09-29T23:05:30.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.173+0000 7fbf87932700 1 -- 172.21.15.115:0/2857228184 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf80070990 con 0x7fbf80141570 2023-09-29T23:05:30.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.173+0000 7fbf757fa700 1 -- 172.21.15.115:0/2857228184 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fbf7801ac20 con 0x7fbf80141570 2023-09-29T23:05:30.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.173+0000 7fbf757fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:30.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.173+0000 7fbf757fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:30.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.173+0000 7fbf757fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:30.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.173+0000 7fbf757fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:30.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.173+0000 7fbf757fa700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbf6408e8b0 0x7fbf64090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:30.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.173+0000 7fbf757fa700 1 -- 172.21.15.115:0/2857228184 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fbf780b5f30 con 0x7fbf80141570 2023-09-29T23:05:30.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.173+0000 7fbf856ce700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbf6408e8b0 0x7fbf64090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:30.178 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.177+0000 7fbf856ce700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbf6408e8b0 0x7fbf64090d60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbf70006fd0 tx=0x7fbf70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:30.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.181+0000 7fbf757fa700 1 -- 172.21.15.115:0/2857228184 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbf780869f0 con 0x7fbf80141570 2023-09-29T23:05:30.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.373+0000 7fbf87932700 1 -- 172.21.15.115:0/2857228184 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbf800a4890 con 0x7fbf80141570 2023-09-29T23:05:30.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.373+0000 7fbf757fa700 1 -- 172.21.15.115:0/2857228184 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fbf78015100 con 0x7fbf80141570 2023-09-29T23:05:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:30.377 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:05:30.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.377+0000 7fbf87932700 10 mgrc shutdown 2023-09-29T23:05:30.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.377+0000 7fbf87932700 1 -- 172.21.15.115:0/2857228184 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbf6408e8b0 msgr2=0x7fbf64090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:30.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.377+0000 7fbf87932700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbf6408e8b0 0x7fbf64090d60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbf70006fd0 tx=0x7fbf70008040 comp rx=0 tx=0).stop 2023-09-29T23:05:30.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.377+0000 7fbf87932700 1 -- 172.21.15.115:0/2857228184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf80141570 msgr2=0x7fbf80099c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:30.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.377+0000 7fbf87932700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf80141570 0x7fbf80099c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf8006b2b0 tx=0x7fbf78017000 comp rx=0 tx=0).stop 2023-09-29T23:05:30.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.377+0000 7fbf87932700 1 -- 172.21.15.115:0/2857228184 shutdown_connections 2023-09-29T23:05:30.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.377+0000 7fbf87932700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf80141570 0x7fbf80099c80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:30.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.377+0000 7fbf87932700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbf6408e8b0 0x7fbf64090d60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:30.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.377+0000 7fbf87932700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf80068480 0x7fbf8006e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:30.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.377+0000 7fbf87932700 1 --2- 172.21.15.115:0/2857228184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf800680b0 0x7fbf801444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:30.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.377+0000 7fbf87932700 1 -- 172.21.15.115:0/2857228184 >> 172.21.15.115:0/2857228184 conn(0x7fbf800695c0 msgr2=0x7fbf8009f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:30.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.377+0000 7fbf87932700 1 -- 172.21.15.115:0/2857228184 shutdown_connections 2023-09-29T23:05:30.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:30.377+0000 7fbf87932700 1 -- 172.21.15.115:0/2857228184 wait complete. 2023-09-29T23:05:33.392 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:05:33.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656dfbf700 1 Processor -- start 2023-09-29T23:05:33.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656dfbf700 1 -- start start 2023-09-29T23:05:33.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656dfbf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f656809fc60 0x7f65680a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:33.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656dfbf700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65680a0030 con 0x7f6568142e50 2023-09-29T23:05:33.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656dfbf700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65680a1ac0 con 0x7f656813fe10 2023-09-29T23:05:33.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656dfbf700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656813fb70 con 0x7f656809fc60 2023-09-29T23:05:33.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f6567fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6568142e50 0x7f65681434f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:47622/0 (socket says 172.21.15.115:47622) 2023-09-29T23:05:33.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f6567fff700 1 -- 172.21.15.115:0/3875219682 learned_addr learned my addr 172.21.15.115:0/3875219682 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:33.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656cfbd700 1 --2- 172.21.15.115:0/3875219682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f656809fc60 0x7f65680a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:33.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f65677fe700 1 -- 172.21.15.115:0/3875219682 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437079981 0 0) 0x7f65680a0030 con 0x7f6568142e50 2023-09-29T23:05:33.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f65677fe700 1 -- 172.21.15.115:0/3875219682 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6550003570 con 0x7f6568142e50 2023-09-29T23:05:33.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656cfbd700 1 -- 172.21.15.115:0/3875219682 >> v1:172.21.15.156:6789/0 conn(0x7f656813fe10 legacy=0x7f6568140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:33.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656cfbd700 1 -- 172.21.15.115:0/3875219682 >> v1:172.21.15.115:6789/0 conn(0x7f6568142e50 legacy=0x7f65681434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:33.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656cfbd700 1 -- 172.21.15.115:0/3875219682 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656813f8d0 con 0x7f656809fc60 2023-09-29T23:05:33.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656cfbd700 1 --2- 172.21.15.115:0/3875219682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f656809fc60 0x7f65680a1580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6558009e90 tx=0x7f6558009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ab2e578e324f5ab server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:33.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f65677fe700 1 -- 172.21.15.115:0/3875219682 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655800e070 con 0x7f656809fc60 2023-09-29T23:05:33.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f65677fe700 1 -- 172.21.15.115:0/3875219682 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655800bc30 con 0x7f656809fc60 2023-09-29T23:05:33.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f65677fe700 1 -- 172.21.15.115:0/3875219682 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558012430 con 0x7f656809fc60 2023-09-29T23:05:33.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656dfbf700 1 -- 172.21.15.115:0/3875219682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f656809fc60 msgr2=0x7f65680a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:33.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656dfbf700 1 --2- 172.21.15.115:0/3875219682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f656809fc60 0x7f65680a1580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6558009e90 tx=0x7f6558009780 comp rx=0 tx=0).stop 2023-09-29T23:05:33.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656dfbf700 1 -- 172.21.15.115:0/3875219682 shutdown_connections 2023-09-29T23:05:33.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656dfbf700 1 --2- 172.21.15.115:0/3875219682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f656809fc60 0x7f65680a1580 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:33.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656dfbf700 1 -- 172.21.15.115:0/3875219682 >> 172.21.15.115:0/3875219682 conn(0x7f65680b6c10 msgr2=0x7f6568067bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:33.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656dfbf700 1 -- 172.21.15.115:0/3875219682 shutdown_connections 2023-09-29T23:05:33.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.504+0000 7f656dfbf700 1 -- 172.21.15.115:0/3875219682 wait complete. 2023-09-29T23:05:33.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656dfbf700 1 Processor -- start 2023-09-29T23:05:33.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656dfbf700 1 -- start start 2023-09-29T23:05:33.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656dfbf700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f656809fc60 0x7f6568144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:33.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656dfbf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f656813fe10 0x7f65680a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:33.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656dfbf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6568142e50 0x7f656813ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:33.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656dfbf700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656813ec00 con 0x7f656809fc60 2023-09-29T23:05:33.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656dfbf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6568145170 con 0x7f6568142e50 2023-09-29T23:05:33.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656dfbf700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656813c6d0 con 0x7f656813fe10 2023-09-29T23:05:33.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656cfbd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f656809fc60 0x7f6568144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:33.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f6567fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f656813fe10 0x7f65680a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:33.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656cfbd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f656809fc60 0x7f6568144c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55204/0 (socket says 172.21.15.115:55204) 2023-09-29T23:05:33.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656cfbd700 1 -- 172.21.15.115:0/2372769608 learned_addr learned my addr 172.21.15.115:0/2372769608 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:33.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656d7be700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6568142e50 0x7f656813ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:33.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656cfbd700 1 -- 172.21.15.115:0/2372769608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f656813fe10 msgr2=0x7f65680a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:33.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656cfbd700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f656813fe10 0x7f65680a5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:33.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656cfbd700 1 -- 172.21.15.115:0/2372769608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6568142e50 msgr2=0x7f656813ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:33.512 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656cfbd700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6568142e50 0x7f656813ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:33.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656cfbd700 1 -- 172.21.15.115:0/2372769608 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6558009a20 con 0x7f656809fc60 2023-09-29T23:05:33.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656d7be700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6568142e50 0x7f656813ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:05:33.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656cfbd700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f656809fc60 0x7f6568144c30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6558009de0 tx=0x7f6558019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:33.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f6564ff9700 1 -- 172.21.15.115:0/2372769608 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558012e60 con 0x7f656809fc60 2023-09-29T23:05:33.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f6564ff9700 1 -- 172.21.15.115:0/2372769608 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6558027470 con 0x7f656809fc60 2023-09-29T23:05:33.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f6564ff9700 1 -- 172.21.15.115:0/2372769608 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558027830 con 0x7f656809fc60 2023-09-29T23:05:33.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656dfbf700 1 -- 172.21.15.115:0/2372769608 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656813d6d0 con 0x7f656809fc60 2023-09-29T23:05:33.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.508+0000 7f656dfbf700 1 -- 172.21.15.115:0/2372769608 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6568139450 con 0x7f656809fc60 2023-09-29T23:05:33.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.512+0000 7f656dfbf700 1 -- 172.21.15.115:0/2372769608 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65681448b0 con 0x7f656809fc60 2023-09-29T23:05:33.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.512+0000 7f6564ff9700 1 -- 172.21.15.115:0/2372769608 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f6558024070 con 0x7f656809fc60 2023-09-29T23:05:33.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.512+0000 7f6564ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:33.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.512+0000 7f6564ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:33.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.512+0000 7f6564ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:33.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.512+0000 7f6564ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:33.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.512+0000 7f6564ff9700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f655408e8b0 0x7f6554090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:33.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.512+0000 7f6564ff9700 1 -- 172.21.15.115:0/2372769608 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f65580b6e60 con 0x7f656809fc60 2023-09-29T23:05:33.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.512+0000 7f6567fff700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f655408e8b0 0x7f6554090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:33.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.512+0000 7f6567fff700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f655408e8b0 0x7f6554090d60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f656813ee70 tx=0x7f655c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:33.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.520+0000 7f6564ff9700 1 -- 172.21.15.115:0/2372769608 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6558087920 con 0x7f656809fc60 2023-09-29T23:05:33.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.708+0000 7f656dfbf700 1 -- 172.21.15.115:0/2372769608 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f656804be00 con 0x7f656809fc60 2023-09-29T23:05:33.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f6564ff9700 1 -- 172.21.15.115:0/2372769608 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f655808af40 con 0x7f656809fc60 2023-09-29T23:05:33.714 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:33.714 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:05:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f656dfbf700 10 mgrc shutdown 2023-09-29T23:05:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f656dfbf700 1 -- 172.21.15.115:0/2372769608 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f655408e8b0 msgr2=0x7f6554090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f656dfbf700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f655408e8b0 0x7f6554090d60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f656813ee70 tx=0x7f655c009040 comp rx=0 tx=0).stop 2023-09-29T23:05:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f656dfbf700 1 -- 172.21.15.115:0/2372769608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f656809fc60 msgr2=0x7f6568144c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f656dfbf700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f656809fc60 0x7f6568144c30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6558009de0 tx=0x7f6558019000 comp rx=0 tx=0).stop 2023-09-29T23:05:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f656dfbf700 1 -- 172.21.15.115:0/2372769608 shutdown_connections 2023-09-29T23:05:33.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f656dfbf700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6568142e50 0x7f656813ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:33.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f656dfbf700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f656813fe10 0x7f65680a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:33.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f656dfbf700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f655408e8b0 0x7f6554090d60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:33.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f656dfbf700 1 --2- 172.21.15.115:0/2372769608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f656809fc60 0x7f6568144c30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:33.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f656dfbf700 1 -- 172.21.15.115:0/2372769608 >> 172.21.15.115:0/2372769608 conn(0x7f65680b6c10 msgr2=0x7f6568067bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:33.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f656dfbf700 1 -- 172.21.15.115:0/2372769608 shutdown_connections 2023-09-29T23:05:33.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:33.712+0000 7f656dfbf700 1 -- 172.21.15.115:0/2372769608 wait complete. 2023-09-29T23:05:36.728 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:05:36.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 Processor -- start 2023-09-29T23:05:36.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 -- start start 2023-09-29T23:05:36.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3df40a36a0 0x7f3df409c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:36.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3df40a0f50 0x7f3df4147090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:36.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df413c680 con 0x7f3df40a32d0 2023-09-29T23:05:36.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df413fd50 con 0x7f3df40a0f50 2023-09-29T23:05:36.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df413fff0 con 0x7f3df40a36a0 2023-09-29T23:05:36.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa1fb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3df40a0f50 0x7f3df4147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:36.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa1fb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3df40a0f50 0x7f3df4147090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56650/0 (socket says 172.21.15.115:56650) 2023-09-29T23:05:36.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa1fb700 1 -- 172.21.15.115:0/1192969983 learned_addr learned my addr 172.21.15.115:0/1192969983 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:36.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3df91f9700 1 --2- 172.21.15.115:0/1192969983 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3df40a36a0 0x7f3df409c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:36.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa1fb700 1 -- 172.21.15.115:0/1192969983 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3df40a36a0 msgr2=0x7f3df409c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:36.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa1fb700 1 --2- 172.21.15.115:0/1192969983 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3df40a36a0 0x7f3df409c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:36.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa1fb700 1 -- 172.21.15.115:0/1192969983 >> v1:172.21.15.156:6789/0 conn(0x7f3df40a32d0 legacy=0x7f3df409e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:36.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa1fb700 1 -- 172.21.15.115:0/1192969983 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4140290 con 0x7f3df40a0f50 2023-09-29T23:05:36.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3df91f9700 1 --2- 172.21.15.115:0/1192969983 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3df40a36a0 0x7f3df409c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:05:36.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa1fb700 1 --2- 172.21.15.115:0/1192969983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3df40a0f50 0x7f3df4147090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0099b0 tx=0x7f3dec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95dd2f5f8169e9f server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:36.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3df89f8700 1 -- 172.21.15.115:0/1192969983 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec00b860 con 0x7f3df40a0f50 2023-09-29T23:05:36.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3df89f8700 1 -- 172.21.15.115:0/1192969983 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dec00b9c0 con 0x7f3df40a0f50 2023-09-29T23:05:36.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3df89f8700 1 -- 172.21.15.115:0/1192969983 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec00bd60 con 0x7f3df40a0f50 2023-09-29T23:05:36.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1192969983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3df40a0f50 msgr2=0x7f3df4147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:36.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 --2- 172.21.15.115:0/1192969983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3df40a0f50 0x7f3df4147090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0099b0 tx=0x7f3dec009250 comp rx=0 tx=0).stop 2023-09-29T23:05:36.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1192969983 shutdown_connections 2023-09-29T23:05:36.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 --2- 172.21.15.115:0/1192969983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3df40a0f50 0x7f3df4147090 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:36.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 --2- 172.21.15.115:0/1192969983 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3df40a36a0 0x7f3df409c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:36.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1192969983 >> 172.21.15.115:0/1192969983 conn(0x7f3df40b1d20 msgr2=0x7f3df40b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:36.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1192969983 shutdown_connections 2023-09-29T23:05:36.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.840+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1192969983 wait complete. 2023-09-29T23:05:36.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.844+0000 7f3dfa9fc700 1 Processor -- start 2023-09-29T23:05:36.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.844+0000 7f3dfa9fc700 1 -- start start 2023-09-29T23:05:36.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.844+0000 7f3dfa9fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3df40a0f50 0x7f3df40971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:36.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.844+0000 7f3dfa9fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3df40a32d0 0x7f3df4138480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:36.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.844+0000 7f3dfa9fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3df40a36a0 0x7f3df41389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:36.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.844+0000 7f3dfa9fc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4094b80 con 0x7f3df40a36a0 2023-09-29T23:05:36.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.844+0000 7f3dfa9fc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4094e20 con 0x7f3df40a32d0 2023-09-29T23:05:36.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.844+0000 7f3dfa9fc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4097920 con 0x7f3df40a0f50 2023-09-29T23:05:36.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.844+0000 7f3df99fa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3df40a0f50 0x7f3df40971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:36.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.844+0000 7f3df99fa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3df40a0f50 0x7f3df40971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:35112/0 (socket says 172.21.15.115:35112) 2023-09-29T23:05:36.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.844+0000 7f3df99fa700 1 -- 172.21.15.115:0/1231088838 learned_addr learned my addr 172.21.15.115:0/1231088838 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:36.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.844+0000 7f3dfa1fb700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3df40a36a0 0x7f3df41389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:36.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.844+0000 7f3df91f9700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3df40a32d0 0x7f3df4138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:36.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.848+0000 7f3df99fa700 1 -- 172.21.15.115:0/1231088838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3df40a32d0 msgr2=0x7f3df4138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:36.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.848+0000 7f3df99fa700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3df40a32d0 0x7f3df4138480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:36.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.848+0000 7f3df99fa700 1 -- 172.21.15.115:0/1231088838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3df40a36a0 msgr2=0x7f3df41389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:36.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.848+0000 7f3df99fa700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3df40a36a0 0x7f3df41389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:36.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.848+0000 7f3df99fa700 1 -- 172.21.15.115:0/1231088838 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0094f0 con 0x7f3df40a0f50 2023-09-29T23:05:36.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.848+0000 7f3dfa1fb700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3df40a36a0 0x7f3df41389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:36.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.848+0000 7f3df99fa700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3df40a0f50 0x7f3df40971c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3de400cb10 tx=0x7f3de40017b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:36.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.848+0000 7f3df1ffb700 1 -- 172.21.15.115:0/1231088838 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400ce20 con 0x7f3df40a0f50 2023-09-29T23:05:36.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.848+0000 7f3df1ffb700 1 -- 172.21.15.115:0/1231088838 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de400a7e0 con 0x7f3df40a0f50 2023-09-29T23:05:36.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.848+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1231088838 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df413bff0 con 0x7f3df40a0f50 2023-09-29T23:05:36.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.848+0000 7f3df1ffb700 1 -- 172.21.15.115:0/1231088838 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400aba0 con 0x7f3df40a0f50 2023-09-29T23:05:36.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.848+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1231088838 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df406e840 con 0x7f3df40a0f50 2023-09-29T23:05:36.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.848+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1231088838 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df413bcd0 con 0x7f3df40a0f50 2023-09-29T23:05:36.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.852+0000 7f3df1ffb700 1 -- 172.21.15.115:0/1231088838 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f3de4003030 con 0x7f3df40a0f50 2023-09-29T23:05:36.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.852+0000 7f3df1ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:36.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.852+0000 7f3df1ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:36.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.852+0000 7f3df1ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:36.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.852+0000 7f3df1ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:36.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.852+0000 7f3df1ffb700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3de008e8b0 0x7f3de0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:36.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.852+0000 7f3df1ffb700 1 -- 172.21.15.115:0/1231088838 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f3de40b48c0 con 0x7f3df40a0f50 2023-09-29T23:05:36.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.852+0000 7f3df91f9700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3de008e8b0 0x7f3de0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:36.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.852+0000 7f3df91f9700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3de008e8b0 0x7f3de0090d60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3df40684a0 tx=0x7f3de8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:36.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:36.856+0000 7f3df1ffb700 1 -- 172.21.15.115:0/1231088838 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3de4085250 con 0x7f3df40a0f50 2023-09-29T23:05:37.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.052+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1231088838 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3df404be00 con 0x7f3df40a0f50 2023-09-29T23:05:37.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3df1ffb700 1 -- 172.21.15.115:0/1231088838 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f3de4088870 con 0x7f3df40a0f50 2023-09-29T23:05:37.058 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:37.058 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:05:37.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3dfa9fc700 10 mgrc shutdown 2023-09-29T23:05:37.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1231088838 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3de008e8b0 msgr2=0x7f3de0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:37.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3dfa9fc700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3de008e8b0 0x7f3de0090d60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3df40684a0 tx=0x7f3de8008040 comp rx=0 tx=0).stop 2023-09-29T23:05:37.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1231088838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3df40a0f50 msgr2=0x7f3df40971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:37.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3dfa9fc700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3df40a0f50 0x7f3df40971c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3de400cb10 tx=0x7f3de40017b0 comp rx=0 tx=0).stop 2023-09-29T23:05:37.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1231088838 shutdown_connections 2023-09-29T23:05:37.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3dfa9fc700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3de008e8b0 0x7f3de0090d60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:37.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3dfa9fc700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3df40a36a0 0x7f3df41389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:37.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3dfa9fc700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3df40a32d0 0x7f3df4138480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:37.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3dfa9fc700 1 --2- 172.21.15.115:0/1231088838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3df40a0f50 0x7f3df40971c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:37.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1231088838 >> 172.21.15.115:0/1231088838 conn(0x7f3df40b1d20 msgr2=0x7f3df4067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:37.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1231088838 shutdown_connections 2023-09-29T23:05:37.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:37.056+0000 7f3dfa9fc700 1 -- 172.21.15.115:0/1231088838 wait complete. 2023-09-29T23:05:38.714 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:05:38.717 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:05:40.073 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:05:40.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca45feb700 1 Processor -- start 2023-09-29T23:05:40.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca45feb700 1 -- start start 2023-09-29T23:05:40.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca45feb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca4013d700 0x7fca40140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:40.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca45feb700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4013e770 con 0x7fca4009d9e0 2023-09-29T23:05:40.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca45feb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4013dc00 con 0x7fca4009ddb0 2023-09-29T23:05:40.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca45feb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca40141d20 con 0x7fca4013d700 2023-09-29T23:05:40.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca457ea700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca4013d700 0x7fca40140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:40.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca44fe9700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fca4009d9e0 0x7fca40141610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:57850/0 (socket says 172.21.15.115:57850) 2023-09-29T23:05:40.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca44fe9700 1 -- 172.21.15.115:0/4035511338 learned_addr learned my addr 172.21.15.115:0/4035511338 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:40.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca457ea700 1 -- 172.21.15.115:0/4035511338 >> v1:172.21.15.156:6789/0 conn(0x7fca4009ddb0 legacy=0x7fca400a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:40.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca457ea700 1 -- 172.21.15.115:0/4035511338 >> v1:172.21.15.115:6789/0 conn(0x7fca4009d9e0 legacy=0x7fca40141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:40.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca457ea700 1 -- 172.21.15.115:0/4035511338 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4013dec0 con 0x7fca4013d700 2023-09-29T23:05:40.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca457ea700 1 --2- 172.21.15.115:0/4035511338 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca4013d700 0x7fca40140d50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca38009910 tx=0x7fca380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e4e1379b68a7699 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:40.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca3f7fe700 1 -- 172.21.15.115:0/4035511338 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3800b8f0 con 0x7fca4013d700 2023-09-29T23:05:40.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca3f7fe700 1 -- 172.21.15.115:0/4035511338 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3800ba50 con 0x7fca4013d700 2023-09-29T23:05:40.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca3f7fe700 1 -- 172.21.15.115:0/4035511338 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3800bdf0 con 0x7fca4013d700 2023-09-29T23:05:40.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca45feb700 1 -- 172.21.15.115:0/4035511338 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca4013d700 msgr2=0x7fca40140d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:40.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.184+0000 7fca45feb700 1 --2- 172.21.15.115:0/4035511338 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca4013d700 0x7fca40140d50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca38009910 tx=0x7fca380091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:40.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca45feb700 1 -- 172.21.15.115:0/4035511338 shutdown_connections 2023-09-29T23:05:40.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca45feb700 1 --2- 172.21.15.115:0/4035511338 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca4013d700 0x7fca40140d50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:40.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca45feb700 1 -- 172.21.15.115:0/4035511338 >> 172.21.15.115:0/4035511338 conn(0x7fca400b1d20 msgr2=0x7fca400b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:40.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca45feb700 1 -- 172.21.15.115:0/4035511338 shutdown_connections 2023-09-29T23:05:40.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca45feb700 1 -- 172.21.15.115:0/4035511338 wait complete. 2023-09-29T23:05:40.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca45feb700 1 Processor -- start 2023-09-29T23:05:40.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca45feb700 1 -- start start 2023-09-29T23:05:40.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca45feb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca4009d9e0 0x7fca40098500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:40.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca45feb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca4009ddb0 0x7fca4006e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:40.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca45feb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4013d700 0x7fca40094a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:40.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca45feb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4006f020 con 0x7fca4009ddb0 2023-09-29T23:05:40.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca45feb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca40095310 con 0x7fca4013d700 2023-09-29T23:05:40.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca45feb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca400955d0 con 0x7fca4009d9e0 2023-09-29T23:05:40.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca44fe9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca4009d9e0 0x7fca40098500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:40.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca3ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca4009ddb0 0x7fca4006e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:40.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca44fe9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca4009d9e0 0x7fca40098500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:35124/0 (socket says 172.21.15.115:35124) 2023-09-29T23:05:40.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca44fe9700 1 -- 172.21.15.115:0/3182489980 learned_addr learned my addr 172.21.15.115:0/3182489980 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:40.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca457ea700 1 --2- 172.21.15.115:0/3182489980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4013d700 0x7fca40094a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:40.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca44fe9700 1 -- 172.21.15.115:0/3182489980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4013d700 msgr2=0x7fca40094a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:40.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca44fe9700 1 --2- 172.21.15.115:0/3182489980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4013d700 0x7fca40094a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:40.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca44fe9700 1 -- 172.21.15.115:0/3182489980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca4009ddb0 msgr2=0x7fca4006e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:40.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca44fe9700 1 --2- 172.21.15.115:0/3182489980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca4009ddb0 0x7fca4006e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:40.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.188+0000 7fca44fe9700 1 -- 172.21.15.115:0/3182489980 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca38009420 con 0x7fca4009d9e0 2023-09-29T23:05:40.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.192+0000 7fca44fe9700 1 --2- 172.21.15.115:0/3182489980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca4009d9e0 0x7fca40098500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fca3400c7c0 tx=0x7fca34007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:40.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.192+0000 7fca3cff9700 1 -- 172.21.15.115:0/3182489980 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34005b30 con 0x7fca4009d9e0 2023-09-29T23:05:40.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.192+0000 7fca3cff9700 1 -- 172.21.15.115:0/3182489980 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca34005c90 con 0x7fca4009d9e0 2023-09-29T23:05:40.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.192+0000 7fca45feb700 1 -- 172.21.15.115:0/3182489980 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca40094f40 con 0x7fca4009d9e0 2023-09-29T23:05:40.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.192+0000 7fca3cff9700 1 -- 172.21.15.115:0/3182489980 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34004a80 con 0x7fca4009d9e0 2023-09-29T23:05:40.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.192+0000 7fca45feb700 1 -- 172.21.15.115:0/3182489980 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4013c320 con 0x7fca4009d9e0 2023-09-29T23:05:40.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.192+0000 7fca45feb700 1 -- 172.21.15.115:0/3182489980 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4004be00 con 0x7fca4009d9e0 2023-09-29T23:05:40.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.196+0000 7fca3cff9700 1 -- 172.21.15.115:0/3182489980 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fca340070d0 con 0x7fca4009d9e0 2023-09-29T23:05:40.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.196+0000 7fca3cff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:40.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.196+0000 7fca3cff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:40.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.196+0000 7fca3cff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:40.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.196+0000 7fca3cff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:40.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.196+0000 7fca3cff9700 1 --2- 172.21.15.115:0/3182489980 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fca2c08e8b0 0x7fca2c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:40.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.196+0000 7fca3cff9700 1 -- 172.21.15.115:0/3182489980 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fca340b3c20 con 0x7fca4009d9e0 2023-09-29T23:05:40.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.196+0000 7fca3ffff700 1 --2- 172.21.15.115:0/3182489980 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fca2c08e8b0 0x7fca2c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:40.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.196+0000 7fca3ffff700 1 --2- 172.21.15.115:0/3182489980 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fca2c08e8b0 0x7fca2c090d60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fca40098020 tx=0x7fca30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:40.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.204+0000 7fca3cff9700 1 -- 172.21.15.115:0/3182489980 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fca34049be0 con 0x7fca4009d9e0 2023-09-29T23:05:40.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.400+0000 7fca45feb700 1 -- 172.21.15.115:0/3182489980 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fca400b1530 con 0x7fca4009d9e0 2023-09-29T23:05:40.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.400+0000 7fca3cff9700 1 -- 172.21.15.115:0/3182489980 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fca34084650 con 0x7fca4009d9e0 2023-09-29T23:05:40.404 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:40.405 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:05:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.404+0000 7fca45feb700 10 mgrc shutdown 2023-09-29T23:05:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.404+0000 7fca45feb700 1 -- 172.21.15.115:0/3182489980 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fca2c08e8b0 msgr2=0x7fca2c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.404+0000 7fca45feb700 1 --2- 172.21.15.115:0/3182489980 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fca2c08e8b0 0x7fca2c090d60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fca40098020 tx=0x7fca30009040 comp rx=0 tx=0).stop 2023-09-29T23:05:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.404+0000 7fca45feb700 1 -- 172.21.15.115:0/3182489980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca4009d9e0 msgr2=0x7fca40098500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.404+0000 7fca45feb700 1 --2- 172.21.15.115:0/3182489980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca4009d9e0 0x7fca40098500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fca3400c7c0 tx=0x7fca34007f70 comp rx=0 tx=0).stop 2023-09-29T23:05:40.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.404+0000 7fca45feb700 1 -- 172.21.15.115:0/3182489980 shutdown_connections 2023-09-29T23:05:40.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.404+0000 7fca45feb700 1 --2- 172.21.15.115:0/3182489980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca4013d700 0x7fca40094a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:40.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.404+0000 7fca45feb700 1 --2- 172.21.15.115:0/3182489980 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fca2c08e8b0 0x7fca2c090d60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:40.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.404+0000 7fca45feb700 1 --2- 172.21.15.115:0/3182489980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca4009ddb0 0x7fca4006e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:40.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.404+0000 7fca45feb700 1 --2- 172.21.15.115:0/3182489980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fca4009d9e0 0x7fca40098500 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:40.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.404+0000 7fca45feb700 1 -- 172.21.15.115:0/3182489980 >> 172.21.15.115:0/3182489980 conn(0x7fca400b1d20 msgr2=0x7fca400a26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:40.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.404+0000 7fca45feb700 1 -- 172.21.15.115:0/3182489980 shutdown_connections 2023-09-29T23:05:40.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:40.404+0000 7fca45feb700 1 -- 172.21.15.115:0/3182489980 wait complete. 2023-09-29T23:05:43.424 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:05:43.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.532+0000 7f734727c700 1 Processor -- start 2023-09-29T23:05:43.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.532+0000 7f734727c700 1 -- start start 2023-09-29T23:05:43.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.532+0000 7f734727c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7340067b60 0x7f73400a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:43.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.532+0000 7f734727c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f734006ef70 0x7f7340143270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:43.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.532+0000 7f734727c700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73400a4830 con 0x7f73400a4370 2023-09-29T23:05:43.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.532+0000 7f734727c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7340067f30 con 0x7f734006ef70 2023-09-29T23:05:43.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.532+0000 7f734727c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734006fa30 con 0x7f7340067b60 2023-09-29T23:05:43.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.532+0000 7f7346a7b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f734006ef70 0x7f7340143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:43.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.532+0000 7f7346a7b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f734006ef70 0x7f7340143270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56676/0 (socket says 172.21.15.115:56676) 2023-09-29T23:05:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.532+0000 7f7346a7b700 1 -- 172.21.15.115:0/1307202293 learned_addr learned my addr 172.21.15.115:0/1307202293 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.532+0000 7f734627a700 1 --2- 172.21.15.115:0/1307202293 >> v2:172.21.15.156:3300/0 conn(0x7f7340067b60 0x7f73400a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f7346a7b700 1 -- 172.21.15.115:0/1307202293 >> v2:172.21.15.156:3300/0 conn(0x7f7340067b60 msgr2=0x7f73400a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f7346a7b700 1 --2- 172.21.15.115:0/1307202293 >> v2:172.21.15.156:3300/0 conn(0x7f7340067b60 0x7f73400a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f7346a7b700 1 -- 172.21.15.115:0/1307202293 >> v1:172.21.15.156:6789/0 conn(0x7f73400a4370 legacy=0x7f734006e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f7346a7b700 1 -- 172.21.15.115:0/1307202293 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734006e410 con 0x7f734006ef70 2023-09-29T23:05:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f7346a7b700 1 --2- 172.21.15.115:0/1307202293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f734006ef70 0x7f7340143270 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7340069990 tx=0x7f7338009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef8fbb35cc70467 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f7345278700 1 -- 172.21.15.115:0/1307202293 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800e070 con 0x7f734006ef70 2023-09-29T23:05:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f7345278700 1 -- 172.21.15.115:0/1307202293 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733800ba50 con 0x7f734006ef70 2023-09-29T23:05:43.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f7345278700 1 -- 172.21.15.115:0/1307202293 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73380092e0 con 0x7f734006ef70 2023-09-29T23:05:43.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f734727c700 1 -- 172.21.15.115:0/1307202293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f734006ef70 msgr2=0x7f7340143270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:43.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f734727c700 1 --2- 172.21.15.115:0/1307202293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f734006ef70 0x7f7340143270 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7340069990 tx=0x7f7338009840 comp rx=0 tx=0).stop 2023-09-29T23:05:43.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f734727c700 1 -- 172.21.15.115:0/1307202293 shutdown_connections 2023-09-29T23:05:43.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f734727c700 1 --2- 172.21.15.115:0/1307202293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f734006ef70 0x7f7340143270 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:43.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f734727c700 1 --2- 172.21.15.115:0/1307202293 >> v2:172.21.15.156:3300/0 conn(0x7f7340067b60 0x7f73400a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:43.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f734727c700 1 -- 172.21.15.115:0/1307202293 >> 172.21.15.115:0/1307202293 conn(0x7f7340068a40 msgr2=0x7f7340068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:43.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f734727c700 1 -- 172.21.15.115:0/1307202293 shutdown_connections 2023-09-29T23:05:43.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f734727c700 1 -- 172.21.15.115:0/1307202293 wait complete. 2023-09-29T23:05:43.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f734727c700 1 Processor -- start 2023-09-29T23:05:43.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f734727c700 1 -- start start 2023-09-29T23:05:43.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f734727c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7340067b60 0x7f734009bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:43.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f734727c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f734006ef70 0x7f73400a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:43.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.536+0000 7f734727c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73400a4370 0x7f73400a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:43.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f734727c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734009b150 con 0x7f734006ef70 2023-09-29T23:05:43.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f734727c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400a1660 con 0x7f73400a4370 2023-09-29T23:05:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f734727c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7340098e10 con 0x7f7340067b60 2023-09-29T23:05:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f7345a79700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f734006ef70 0x7f73400a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f734627a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7340067b60 0x7f734009bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f7345a79700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f734006ef70 0x7f73400a1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56688/0 (socket says 172.21.15.115:56688) 2023-09-29T23:05:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f7346a7b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73400a4370 0x7f73400a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f7345a79700 1 -- 172.21.15.115:0/1094218647 learned_addr learned my addr 172.21.15.115:0/1094218647 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f734627a700 1 -- 172.21.15.115:0/1094218647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73400a4370 msgr2=0x7f73400a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f734627a700 1 --2- 172.21.15.115:0/1094218647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73400a4370 0x7f73400a1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f734627a700 1 -- 172.21.15.115:0/1094218647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f734006ef70 msgr2=0x7f73400a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f734627a700 1 --2- 172.21.15.115:0/1094218647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f734006ef70 0x7f73400a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f734627a700 1 -- 172.21.15.115:0/1094218647 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7338009ae0 con 0x7f7340067b60 2023-09-29T23:05:43.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f7345a79700 1 --2- 172.21.15.115:0/1094218647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f734006ef70 0x7f73400a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f734627a700 1 --2- 172.21.15.115:0/1094218647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7340067b60 0x7f734009bb80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f733c00d890 tx=0x7f733c008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f73367fc700 1 -- 172.21.15.115:0/1094218647 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0125f0 con 0x7f7340067b60 2023-09-29T23:05:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f73367fc700 1 -- 172.21.15.115:0/1094218647 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c012770 con 0x7f7340067b60 2023-09-29T23:05:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f734727c700 1 -- 172.21.15.115:0/1094218647 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73400990d0 con 0x7f7340067b60 2023-09-29T23:05:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f73367fc700 1 -- 172.21.15.115:0/1094218647 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c012b30 con 0x7f7340067b60 2023-09-29T23:05:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f734727c700 1 -- 172.21.15.115:0/1094218647 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73400a2060 con 0x7f7340067b60 2023-09-29T23:05:43.545 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.540+0000 7f734727c700 1 -- 172.21.15.115:0/1094218647 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734004be00 con 0x7f7340067b60 2023-09-29T23:05:43.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.544+0000 7f73367fc700 1 -- 172.21.15.115:0/1094218647 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f733c013480 con 0x7f7340067b60 2023-09-29T23:05:43.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.544+0000 7f73367fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:43.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.544+0000 7f73367fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:43.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.544+0000 7f73367fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:43.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.544+0000 7f73367fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:43.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.544+0000 7f73367fc700 1 --2- 172.21.15.115:0/1094218647 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f732408e8e0 0x7f7324090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:43.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.544+0000 7f73367fc700 1 -- 172.21.15.115:0/1094218647 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f733c0b4bf0 con 0x7f7340067b60 2023-09-29T23:05:43.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.544+0000 7f7345a79700 1 --2- 172.21.15.115:0/1094218647 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f732408e8e0 0x7f7324090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:43.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.544+0000 7f7345a79700 1 --2- 172.21.15.115:0/1094218647 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f732408e8e0 0x7f7324090d90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7340134430 tx=0x7f7330009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:43.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.552+0000 7f73367fc700 1 -- 172.21.15.115:0/1094218647 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f733c085580 con 0x7f7340067b60 2023-09-29T23:05:43.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.744+0000 7f734727c700 1 -- 172.21.15.115:0/1094218647 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f73401437b0 con 0x7f7340067b60 2023-09-29T23:05:43.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.748+0000 7f73367fc700 1 -- 172.21.15.115:0/1094218647 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f733c088ba0 con 0x7f7340067b60 2023-09-29T23:05:43.750 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:43.750 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:05:43.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.752+0000 7f734727c700 10 mgrc shutdown 2023-09-29T23:05:43.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.752+0000 7f734727c700 1 -- 172.21.15.115:0/1094218647 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f732408e8e0 msgr2=0x7f7324090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:43.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.752+0000 7f734727c700 1 --2- 172.21.15.115:0/1094218647 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f732408e8e0 0x7f7324090d90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7340134430 tx=0x7f7330009040 comp rx=0 tx=0).stop 2023-09-29T23:05:43.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.752+0000 7f734727c700 1 -- 172.21.15.115:0/1094218647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7340067b60 msgr2=0x7f734009bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:43.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.752+0000 7f734727c700 1 --2- 172.21.15.115:0/1094218647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7340067b60 0x7f734009bb80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f733c00d890 tx=0x7f733c008040 comp rx=0 tx=0).stop 2023-09-29T23:05:43.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.752+0000 7f734727c700 1 -- 172.21.15.115:0/1094218647 shutdown_connections 2023-09-29T23:05:43.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.752+0000 7f734727c700 1 --2- 172.21.15.115:0/1094218647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73400a4370 0x7f73400a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:43.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.752+0000 7f734727c700 1 --2- 172.21.15.115:0/1094218647 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f732408e8e0 0x7f7324090d90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:43.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.752+0000 7f734727c700 1 --2- 172.21.15.115:0/1094218647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f734006ef70 0x7f73400a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:43.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.752+0000 7f734727c700 1 --2- 172.21.15.115:0/1094218647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7340067b60 0x7f734009bb80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:43.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.752+0000 7f734727c700 1 -- 172.21.15.115:0/1094218647 >> 172.21.15.115:0/1094218647 conn(0x7f7340068a40 msgr2=0x7f7340144090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:43.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.752+0000 7f734727c700 1 -- 172.21.15.115:0/1094218647 shutdown_connections 2023-09-29T23:05:43.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:43.752+0000 7f734727c700 1 -- 172.21.15.115:0/1094218647 wait complete. 2023-09-29T23:05:46.771 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:05:46.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.880+0000 7f4a7bdb3700 1 Processor -- start 2023-09-29T23:05:46.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.880+0000 7f4a7bdb3700 1 -- start start 2023-09-29T23:05:46.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a7bdb3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a740680b0 0x7f4a7409f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:46.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a7bdb3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7409fd00 con 0x7f4a74141570 2023-09-29T23:05:46.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a7bdb3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a74140ff0 con 0x7f4a74068480 2023-09-29T23:05:46.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a7bdb3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7409b870 con 0x7f4a740680b0 2023-09-29T23:05:46.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a79b4f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a740680b0 0x7f4a7409f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:46.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a79b4f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a740680b0 0x7f4a7409f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:49462/0 (socket says 172.21.15.115:49462) 2023-09-29T23:05:46.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a79b4f700 1 -- 172.21.15.115:0/2897653656 learned_addr learned my addr 172.21.15.115:0/2897653656 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:46.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a7a350700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4a74141570 0x7f4a74148210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56252/0 (socket says 172.21.15.115:56252) 2023-09-29T23:05:46.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a79b4f700 1 -- 172.21.15.115:0/2897653656 >> v1:172.21.15.156:6789/0 conn(0x7f4a74068480 legacy=0x7f4a7409b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:46.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a79b4f700 1 -- 172.21.15.115:0/2897653656 >> v1:172.21.15.115:6789/0 conn(0x7f4a74141570 legacy=0x7f4a74148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:46.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a79b4f700 1 -- 172.21.15.115:0/2897653656 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a741412b0 con 0x7f4a740680b0 2023-09-29T23:05:46.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a79b4f700 1 --2- 172.21.15.115:0/2897653656 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a740680b0 0x7f4a7409f7c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a741414a0 tx=0x7f4a6c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d49605803831c332 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:46.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a78b4d700 1 -- 172.21.15.115:0/2897653656 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c00e070 con 0x7f4a740680b0 2023-09-29T23:05:46.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a78b4d700 1 -- 172.21.15.115:0/2897653656 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c00ba80 con 0x7f4a740680b0 2023-09-29T23:05:46.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a78b4d700 1 -- 172.21.15.115:0/2897653656 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c00be40 con 0x7f4a740680b0 2023-09-29T23:05:46.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2897653656 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a740680b0 msgr2=0x7f4a7409f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:46.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a7bdb3700 1 --2- 172.21.15.115:0/2897653656 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a740680b0 0x7f4a7409f7c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a741414a0 tx=0x7f4a6c009840 comp rx=0 tx=0).stop 2023-09-29T23:05:46.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2897653656 shutdown_connections 2023-09-29T23:05:46.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a7bdb3700 1 --2- 172.21.15.115:0/2897653656 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a740680b0 0x7f4a7409f7c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:46.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2897653656 >> 172.21.15.115:0/2897653656 conn(0x7f4a740695c0 msgr2=0x7f4a740699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:46.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2897653656 shutdown_connections 2023-09-29T23:05:46.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.884+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2897653656 wait complete. 2023-09-29T23:05:46.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7bdb3700 1 Processor -- start 2023-09-29T23:05:46.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7bdb3700 1 -- start start 2023-09-29T23:05:46.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7bdb3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a740680b0 0x7f4a740951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:46.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7bdb3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a74068480 0x7f4a7413c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:46.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7bdb3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a74141570 0x7f4a7413c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:46.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7bdb3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7413cba0 con 0x7f4a74068480 2023-09-29T23:05:46.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7bdb3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a741457d0 con 0x7f4a74141570 2023-09-29T23:05:46.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7bdb3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7413cd90 con 0x7f4a740680b0 2023-09-29T23:05:46.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7934e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a74068480 0x7f4a7413c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:46.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a79b4f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a740680b0 0x7f4a740951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:46.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7934e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a74068480 0x7f4a7413c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40062/0 (socket says 172.21.15.115:40062) 2023-09-29T23:05:46.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7934e700 1 -- 172.21.15.115:0/2184884535 learned_addr learned my addr 172.21.15.115:0/2184884535 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:46.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7a350700 1 --2- 172.21.15.115:0/2184884535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a74141570 0x7f4a7413c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:46.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7934e700 1 -- 172.21.15.115:0/2184884535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a740680b0 msgr2=0x7f4a740951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:46.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7934e700 1 --2- 172.21.15.115:0/2184884535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a740680b0 0x7f4a740951f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:46.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7934e700 1 -- 172.21.15.115:0/2184884535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a74141570 msgr2=0x7f4a7413c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:46.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7934e700 1 --2- 172.21.15.115:0/2184884535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a74141570 0x7f4a7413c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:46.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7934e700 1 -- 172.21.15.115:0/2184884535 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c009ae0 con 0x7f4a74068480 2023-09-29T23:05:46.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.888+0000 7f4a7934e700 1 --2- 172.21.15.115:0/2184884535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a74068480 0x7f4a7413c120 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800c7c0 tx=0x7f4a68007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:46.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.892+0000 7f4a71ffb700 1 -- 172.21.15.115:0/2184884535 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68011590 con 0x7f4a74068480 2023-09-29T23:05:46.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.892+0000 7f4a71ffb700 1 -- 172.21.15.115:0/2184884535 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a68011710 con 0x7f4a74068480 2023-09-29T23:05:46.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.892+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2184884535 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a74141a70 con 0x7f4a74068480 2023-09-29T23:05:46.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.892+0000 7f4a71ffb700 1 -- 172.21.15.115:0/2184884535 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68011ad0 con 0x7f4a74068480 2023-09-29T23:05:46.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.892+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2184884535 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a74095730 con 0x7f4a74068480 2023-09-29T23:05:46.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.892+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2184884535 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a74070990 con 0x7f4a74068480 2023-09-29T23:05:46.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.896+0000 7f4a71ffb700 1 -- 172.21.15.115:0/2184884535 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f4a6801b3b0 con 0x7f4a74068480 2023-09-29T23:05:46.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.896+0000 7f4a71ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:46.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.896+0000 7f4a71ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:46.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.896+0000 7f4a71ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:46.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.896+0000 7f4a71ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:46.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.896+0000 7f4a71ffb700 1 --2- 172.21.15.115:0/2184884535 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4a6008e8b0 0x7f4a60090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:46.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.896+0000 7f4a71ffb700 1 -- 172.21.15.115:0/2184884535 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f4a680b3cf0 con 0x7f4a74068480 2023-09-29T23:05:46.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.896+0000 7f4a79b4f700 1 --2- 172.21.15.115:0/2184884535 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4a6008e8b0 0x7f4a60090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:46.900 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.896+0000 7f4a79b4f700 1 --2- 172.21.15.115:0/2184884535 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4a6008e8b0 0x7f4a60090d60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009ea0 tx=0x7f4a6c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:46.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:46.900+0000 7f4a71ffb700 1 -- 172.21.15.115:0/2184884535 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4a680b8070 con 0x7f4a74068480 2023-09-29T23:05:47.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.100+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2184884535 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4a741436e0 con 0x7f4a74068480 2023-09-29T23:05:47.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a71ffb700 1 -- 172.21.15.115:0/2184884535 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f4a68017070 con 0x7f4a74068480 2023-09-29T23:05:47.106 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:47.106 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:05:47.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a7bdb3700 10 mgrc shutdown 2023-09-29T23:05:47.108 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2184884535 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4a6008e8b0 msgr2=0x7f4a60090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:47.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a7bdb3700 1 --2- 172.21.15.115:0/2184884535 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4a6008e8b0 0x7f4a60090d60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009ea0 tx=0x7f4a6c017000 comp rx=0 tx=0).stop 2023-09-29T23:05:47.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2184884535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a74068480 msgr2=0x7f4a7413c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:47.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a7bdb3700 1 --2- 172.21.15.115:0/2184884535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a74068480 0x7f4a7413c120 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800c7c0 tx=0x7f4a68007f50 comp rx=0 tx=0).stop 2023-09-29T23:05:47.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2184884535 shutdown_connections 2023-09-29T23:05:47.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a7bdb3700 1 --2- 172.21.15.115:0/2184884535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a74141570 0x7f4a7413c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:47.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a7bdb3700 1 --2- 172.21.15.115:0/2184884535 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4a6008e8b0 0x7f4a60090d60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:47.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a7bdb3700 1 --2- 172.21.15.115:0/2184884535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a74068480 0x7f4a7413c120 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:47.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a7bdb3700 1 --2- 172.21.15.115:0/2184884535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a740680b0 0x7f4a740951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:47.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2184884535 >> 172.21.15.115:0/2184884535 conn(0x7f4a740695c0 msgr2=0x7f4a740b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:47.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2184884535 shutdown_connections 2023-09-29T23:05:47.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:47.104+0000 7f4a7bdb3700 1 -- 172.21.15.115:0/2184884535 wait complete. 2023-09-29T23:05:50.121 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:05:50.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.224+0000 7fb6c5120700 1 Processor -- start 2023-09-29T23:05:50.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.224+0000 7fb6c5120700 1 -- start start 2023-09-29T23:05:50.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.224+0000 7fb6c5120700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb6c009d320 0x7fb6c00a4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:50.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.224+0000 7fb6c5120700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6c00670a0 0x7fb6c013fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:50.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.224+0000 7fb6c5120700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c009ce00 con 0x7fb6c0067b60 2023-09-29T23:05:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6c5120700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c009c630 con 0x7fb6c009d320 2023-09-29T23:05:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6c5120700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c0067f30 con 0x7fb6c00670a0 2023-09-29T23:05:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6bffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb6c0067b60 0x7fb6c009bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56260/0 (socket says 172.21.15.115:56260) 2023-09-29T23:05:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6bffff700 1 -- 172.21.15.115:0/1152845665 learned_addr learned my addr 172.21.15.115:0/1152845665 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6bf7fe700 1 --2- 172.21.15.115:0/1152845665 >> v2:172.21.15.115:3300/0 conn(0x7fb6c009d320 0x7fb6c00a4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6c491f700 1 --2- 172.21.15.115:0/1152845665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6c00670a0 0x7fb6c013fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6beffd700 1 -- 172.21.15.115:0/1152845665 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966088239 0 0) 0x7fb6c009ce00 con 0x7fb6c0067b60 2023-09-29T23:05:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6beffd700 1 -- 172.21.15.115:0/1152845665 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6a8003570 con 0x7fb6c0067b60 2023-09-29T23:05:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6beffd700 1 -- 172.21.15.115:0/1152845665 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2393318905 0 0) 0x7fb6a8003570 con 0x7fb6c0067b60 2023-09-29T23:05:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6bf7fe700 1 -- 172.21.15.115:0/1152845665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6c00670a0 msgr2=0x7fb6c013fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6bf7fe700 1 --2- 172.21.15.115:0/1152845665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6c00670a0 0x7fb6c013fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6bf7fe700 1 -- 172.21.15.115:0/1152845665 >> v1:172.21.15.115:6789/0 conn(0x7fb6c0067b60 legacy=0x7fb6c009bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:50.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6bf7fe700 1 -- 172.21.15.115:0/1152845665 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c009d6f0 con 0x7fb6c009d320 2023-09-29T23:05:50.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6bf7fe700 1 --2- 172.21.15.115:0/1152845665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c009d320 0x7fb6c00a4120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40098e0 tx=0x7fb6b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb9818730eb9c03 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:50.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6beffd700 1 -- 172.21.15.115:0/1152845665 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8001810 con 0x7fb6c009d320 2023-09-29T23:05:50.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6beffd700 1 -- 172.21.15.115:0/1152845665 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b4011420 con 0x7fb6c009d320 2023-09-29T23:05:50.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6beffd700 1 -- 172.21.15.115:0/1152845665 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b40117c0 con 0x7fb6c009d320 2023-09-29T23:05:50.235 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6c5120700 1 -- 172.21.15.115:0/1152845665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c009d320 msgr2=0x7fb6c00a4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6c5120700 1 --2- 172.21.15.115:0/1152845665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c009d320 0x7fb6c00a4120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40098e0 tx=0x7fb6b40091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6c5120700 1 -- 172.21.15.115:0/1152845665 shutdown_connections 2023-09-29T23:05:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6c5120700 1 --2- 172.21.15.115:0/1152845665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6c00670a0 0x7fb6c013fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6c5120700 1 --2- 172.21.15.115:0/1152845665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c009d320 0x7fb6c00a4120 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6c5120700 1 -- 172.21.15.115:0/1152845665 >> 172.21.15.115:0/1152845665 conn(0x7fb6c00b1d20 msgr2=0x7fb6c00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6c5120700 1 -- 172.21.15.115:0/1152845665 shutdown_connections 2023-09-29T23:05:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6c5120700 1 -- 172.21.15.115:0/1152845665 wait complete. 2023-09-29T23:05:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6c5120700 1 Processor -- start 2023-09-29T23:05:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.228+0000 7fb6c5120700 1 -- start start 2023-09-29T23:05:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6c5120700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c00670a0 0x7fb6c006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6c5120700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6c0067b60 0x7fb6c006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:50.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6c5120700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c009d320 0x7fb6c013a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6c5120700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c013ba70 con 0x7fb6c00670a0 2023-09-29T23:05:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6c5120700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c006e800 con 0x7fb6c009d320 2023-09-29T23:05:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6c5120700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c013b0b0 con 0x7fb6c0067b60 2023-09-29T23:05:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6bffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c00670a0 0x7fb6c006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6bffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c00670a0 0x7fb6c006de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40072/0 (socket says 172.21.15.115:40072) 2023-09-29T23:05:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6bf7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6c0067b60 0x7fb6c006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6bffff700 1 -- 172.21.15.115:0/3885640825 learned_addr learned my addr 172.21.15.115:0/3885640825 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6bffff700 1 -- 172.21.15.115:0/3885640825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6c0067b60 msgr2=0x7fb6c006ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6bffff700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6c0067b60 0x7fb6c006ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6bffff700 1 -- 172.21.15.115:0/3885640825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c009d320 msgr2=0x7fb6c013a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6c491f700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c009d320 0x7fb6c013a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6bffff700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c009d320 0x7fb6c013a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:50.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6bffff700 1 -- 172.21.15.115:0/3885640825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b4009420 con 0x7fb6c00670a0 2023-09-29T23:05:50.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6c491f700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c009d320 0x7fb6c013a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:05:50.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6bffff700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c00670a0 0x7fb6c006de50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800cca0 tx=0x7fb6b8001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:50.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6a7fff700 1 -- 172.21.15.115:0/3885640825 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8004dc0 con 0x7fb6c00670a0 2023-09-29T23:05:50.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6a7fff700 1 -- 172.21.15.115:0/3885640825 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b800a770 con 0x7fb6c00670a0 2023-09-29T23:05:50.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6c5120700 1 -- 172.21.15.115:0/3885640825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c0144010 con 0x7fb6c00670a0 2023-09-29T23:05:50.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6a7fff700 1 -- 172.21.15.115:0/3885640825 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b800ab30 con 0x7fb6c00670a0 2023-09-29T23:05:50.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6c5120700 1 -- 172.21.15.115:0/3885640825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c0094ba0 con 0x7fb6c00670a0 2023-09-29T23:05:50.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.232+0000 7fb6c5120700 1 -- 172.21.15.115:0/3885640825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c004be00 con 0x7fb6c00670a0 2023-09-29T23:05:50.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.236+0000 7fb6a7fff700 1 -- 172.21.15.115:0/3885640825 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fb6b8007150 con 0x7fb6c00670a0 2023-09-29T23:05:50.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.236+0000 7fb6a7fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:50.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.236+0000 7fb6a7fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:50.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.236+0000 7fb6a7fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:50.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.236+0000 7fb6a7fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:50.239 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.236+0000 7fb6a7fff700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb6ac08e8b0 0x7fb6ac090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:50.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.236+0000 7fb6a7fff700 1 -- 172.21.15.115:0/3885640825 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fb6b80b4400 con 0x7fb6c00670a0 2023-09-29T23:05:50.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.236+0000 7fb6bf7fe700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb6ac08e8b0 0x7fb6ac090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:50.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.236+0000 7fb6bf7fe700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb6ac08e8b0 0x7fb6ac090d60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40030c0 tx=0x7fb6b4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:50.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.240+0000 7fb6a7fff700 1 -- 172.21.15.115:0/3885640825 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb6b8084e30 con 0x7fb6c00670a0 2023-09-29T23:05:50.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.432+0000 7fb6c5120700 1 -- 172.21.15.115:0/3885640825 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb6c00a3460 con 0x7fb6c00670a0 2023-09-29T23:05:50.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.432+0000 7fb6a7fff700 1 -- 172.21.15.115:0/3885640825 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fb6b8018020 con 0x7fb6c00670a0 2023-09-29T23:05:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:50.436 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:05:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.436+0000 7fb6c5120700 10 mgrc shutdown 2023-09-29T23:05:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.436+0000 7fb6c5120700 1 -- 172.21.15.115:0/3885640825 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb6ac08e8b0 msgr2=0x7fb6ac090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.436+0000 7fb6c5120700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb6ac08e8b0 0x7fb6ac090d60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40030c0 tx=0x7fb6b4016000 comp rx=0 tx=0).stop 2023-09-29T23:05:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.436+0000 7fb6c5120700 1 -- 172.21.15.115:0/3885640825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c00670a0 msgr2=0x7fb6c006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.436+0000 7fb6c5120700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c00670a0 0x7fb6c006de50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800cca0 tx=0x7fb6b8001690 comp rx=0 tx=0).stop 2023-09-29T23:05:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.436+0000 7fb6c5120700 1 -- 172.21.15.115:0/3885640825 shutdown_connections 2023-09-29T23:05:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.436+0000 7fb6c5120700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb6c009d320 0x7fb6c013a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:50.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.436+0000 7fb6c5120700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6c0067b60 0x7fb6c006ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.436+0000 7fb6c5120700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb6ac08e8b0 0x7fb6ac090d60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.436+0000 7fb6c5120700 1 --2- 172.21.15.115:0/3885640825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6c00670a0 0x7fb6c006de50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.436+0000 7fb6c5120700 1 -- 172.21.15.115:0/3885640825 >> 172.21.15.115:0/3885640825 conn(0x7fb6c00b1d20 msgr2=0x7fb6c00afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.436+0000 7fb6c5120700 1 -- 172.21.15.115:0/3885640825 shutdown_connections 2023-09-29T23:05:50.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:50.436+0000 7fb6c5120700 1 -- 172.21.15.115:0/3885640825 wait complete. 2023-09-29T23:05:53.452 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:05:53.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2dffff700 1 Processor -- start 2023-09-29T23:05:53.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2dffff700 1 -- start start 2023-09-29T23:05:53.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2dffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff2e013af70 0x7ff2e0067d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:53.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2dffff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e013df40 con 0x7ff2e00675e0 2023-09-29T23:05:53.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2dffff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e013e200 con 0x7ff2e006d400 2023-09-29T23:05:53.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2dffff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e00a36c0 con 0x7ff2e013af70 2023-09-29T23:05:53.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2deffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff2e013af70 0x7ff2e0067d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:53.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2df7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff2e00675e0 0x7ff2e009e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56272/0 (socket says 172.21.15.115:56272) 2023-09-29T23:05:53.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2df7fe700 1 -- 172.21.15.115:0/669237995 learned_addr learned my addr 172.21.15.115:0/669237995 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:05:53.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2ddffb700 1 -- 172.21.15.115:0/669237995 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057961497 0 0) 0x7ff2e013df40 con 0x7ff2e00675e0 2023-09-29T23:05:53.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2ddffb700 1 -- 172.21.15.115:0/669237995 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c8003570 con 0x7ff2e00675e0 2023-09-29T23:05:53.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2deffd700 1 -- 172.21.15.115:0/669237995 >> v1:172.21.15.156:6789/0 conn(0x7ff2e006d400 legacy=0x7ff2e013d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:53.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2deffd700 1 -- 172.21.15.115:0/669237995 >> v1:172.21.15.115:6789/0 conn(0x7ff2e00675e0 legacy=0x7ff2e009e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:53.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2deffd700 1 -- 172.21.15.115:0/669237995 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e0068df0 con 0x7ff2e013af70 2023-09-29T23:05:53.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2deffd700 1 --2- 172.21.15.115:0/669237995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e013af70 0x7ff2e0067d20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40098e0 tx=0x7ff2d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cb1d8ef2dbeeb server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:53.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2ddffb700 1 -- 172.21.15.115:0/669237995 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400b640 con 0x7ff2e013af70 2023-09-29T23:05:53.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2ddffb700 1 -- 172.21.15.115:0/669237995 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d400b7a0 con 0x7ff2e013af70 2023-09-29T23:05:53.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2ddffb700 1 -- 172.21.15.115:0/669237995 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400bb20 con 0x7ff2e013af70 2023-09-29T23:05:53.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2dffff700 1 -- 172.21.15.115:0/669237995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e013af70 msgr2=0x7ff2e0067d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:53.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2dffff700 1 --2- 172.21.15.115:0/669237995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e013af70 0x7ff2e0067d20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40098e0 tx=0x7ff2d40091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:53.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2dffff700 1 -- 172.21.15.115:0/669237995 shutdown_connections 2023-09-29T23:05:53.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2dffff700 1 --2- 172.21.15.115:0/669237995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e013af70 0x7ff2e0067d20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:53.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.560+0000 7ff2dffff700 1 -- 172.21.15.115:0/669237995 >> 172.21.15.115:0/669237995 conn(0x7ff2e00a2a60 msgr2=0x7ff2e00a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:53.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2dffff700 1 -- 172.21.15.115:0/669237995 shutdown_connections 2023-09-29T23:05:53.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2dffff700 1 -- 172.21.15.115:0/669237995 wait complete. 2023-09-29T23:05:53.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2dffff700 1 Processor -- start 2023-09-29T23:05:53.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2dffff700 1 -- start start 2023-09-29T23:05:53.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2dffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2e00675e0 0x7ff2e0135450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:53.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2dffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2e006d400 0x7ff2e0139400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:53.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2dffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e013af70 0x7ff2e0150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:53.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2dffff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e0135d20 con 0x7ff2e013af70 2023-09-29T23:05:53.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2dffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e013a3b0 con 0x7ff2e00675e0 2023-09-29T23:05:53.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2dffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e013a670 con 0x7ff2e006d400 2023-09-29T23:05:53.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2de7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2e006d400 0x7ff2e0139400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:53.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2df7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e013af70 0x7ff2e0150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:53.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2de7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2e006d400 0x7ff2e0139400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:49492/0 (socket says 172.21.15.115:49492) 2023-09-29T23:05:53.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2df7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e013af70 0x7ff2e0150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40082/0 (socket says 172.21.15.115:40082) 2023-09-29T23:05:53.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2de7fc700 1 -- 172.21.15.115:0/2322563089 learned_addr learned my addr 172.21.15.115:0/2322563089 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:53.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2deffd700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2e00675e0 0x7ff2e0135450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:53.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2df7fe700 1 -- 172.21.15.115:0/2322563089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2e006d400 msgr2=0x7ff2e0139400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:53.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2df7fe700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2e006d400 0x7ff2e0139400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:53.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2df7fe700 1 -- 172.21.15.115:0/2322563089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2e00675e0 msgr2=0x7ff2e0135450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:53.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2df7fe700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2e00675e0 0x7ff2e0135450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:53.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2df7fe700 1 -- 172.21.15.115:0/2322563089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d4009420 con 0x7ff2e013af70 2023-09-29T23:05:53.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.564+0000 7ff2de7fc700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2e006d400 0x7ff2e0139400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:05:53.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.568+0000 7ff2df7fe700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e013af70 0x7ff2e0150a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800cbc0 tx=0x7ff2d8001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:53.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.568+0000 7ff2c6ffd700 1 -- 172.21.15.115:0/2322563089 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800a7e0 con 0x7ff2e013af70 2023-09-29T23:05:53.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.568+0000 7ff2c6ffd700 1 -- 172.21.15.115:0/2322563089 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d800a940 con 0x7ff2e013af70 2023-09-29T23:05:53.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.568+0000 7ff2c6ffd700 1 -- 172.21.15.115:0/2322563089 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800acc0 con 0x7ff2e013af70 2023-09-29T23:05:53.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.568+0000 7ff2dffff700 1 -- 172.21.15.115:0/2322563089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e0139940 con 0x7ff2e013af70 2023-09-29T23:05:53.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.568+0000 7ff2dffff700 1 -- 172.21.15.115:0/2322563089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e006f610 con 0x7ff2e013af70 2023-09-29T23:05:53.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.568+0000 7ff2dffff700 1 -- 172.21.15.115:0/2322563089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e004be00 con 0x7ff2e013af70 2023-09-29T23:05:53.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.568+0000 7ff2c6ffd700 1 -- 172.21.15.115:0/2322563089 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7ff2d8007300 con 0x7ff2e013af70 2023-09-29T23:05:53.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.568+0000 7ff2c6ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:53.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.568+0000 7ff2c6ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:53.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.568+0000 7ff2c6ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:53.573 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.568+0000 7ff2c6ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:53.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.568+0000 7ff2c6ffd700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff2cc08e8b0 0x7ff2cc090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:53.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.572+0000 7ff2c6ffd700 1 -- 172.21.15.115:0/2322563089 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7ff2d80b4c20 con 0x7ff2e013af70 2023-09-29T23:05:53.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.572+0000 7ff2deffd700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff2cc08e8b0 0x7ff2cc090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:53.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.572+0000 7ff2deffd700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff2cc08e8b0 0x7ff2cc090d60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40093f0 tx=0x7ff2d4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:53.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.580+0000 7ff2c6ffd700 1 -- 172.21.15.115:0/2322563089 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff2d8089050 con 0x7ff2e013af70 2023-09-29T23:05:53.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.764+0000 7ff2dffff700 1 -- 172.21.15.115:0/2322563089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff2e0068330 con 0x7ff2e013af70 2023-09-29T23:05:53.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2c6ffd700 1 -- 172.21.15.115:0/2322563089 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff2d8087460 con 0x7ff2e013af70 2023-09-29T23:05:53.770 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:53.770 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:05:53.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2dffff700 10 mgrc shutdown 2023-09-29T23:05:53.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2dffff700 1 -- 172.21.15.115:0/2322563089 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff2cc08e8b0 msgr2=0x7ff2cc090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:53.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2dffff700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff2cc08e8b0 0x7ff2cc090d60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40093f0 tx=0x7ff2d4017000 comp rx=0 tx=0).stop 2023-09-29T23:05:53.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2dffff700 1 -- 172.21.15.115:0/2322563089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e013af70 msgr2=0x7ff2e0150a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:53.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2dffff700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e013af70 0x7ff2e0150a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800cbc0 tx=0x7ff2d8001a20 comp rx=0 tx=0).stop 2023-09-29T23:05:53.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2dffff700 1 -- 172.21.15.115:0/2322563089 shutdown_connections 2023-09-29T23:05:53.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2dffff700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff2cc08e8b0 0x7ff2cc090d60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:53.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2dffff700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2e013af70 0x7ff2e0150a30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:53.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2dffff700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2e006d400 0x7ff2e0139400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:53.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2dffff700 1 --2- 172.21.15.115:0/2322563089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff2e00675e0 0x7ff2e0135450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:53.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2dffff700 1 -- 172.21.15.115:0/2322563089 >> 172.21.15.115:0/2322563089 conn(0x7ff2e00a2a60 msgr2=0x7ff2e00b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:53.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2dffff700 1 -- 172.21.15.115:0/2322563089 shutdown_connections 2023-09-29T23:05:53.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:53.768+0000 7ff2dffff700 1 -- 172.21.15.115:0/2322563089 wait complete. 2023-09-29T23:05:56.786 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:05:56.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe5a370700 1 Processor -- start 2023-09-29T23:05:56.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe5a370700 1 -- start start 2023-09-29T23:05:56.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe5a370700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efe540a4140 0x7efe540670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:56.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe5a370700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe5409d680 0x7efe5409da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:56.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe5a370700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe540675e0 con 0x7efe54067a20 2023-09-29T23:05:56.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe5a370700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe540a3710 con 0x7efe5409d680 2023-09-29T23:05:56.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe5a370700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5409bd40 con 0x7efe540a4140 2023-09-29T23:05:56.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe58b6d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe5409d680 0x7efe5409da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:56.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe58b6d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe5409d680 0x7efe5409da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58690/0 (socket says 172.21.15.115:58690) 2023-09-29T23:05:56.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe58b6d700 1 -- 172.21.15.115:0/1312628399 learned_addr learned my addr 172.21.15.115:0/1312628399 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:56.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe5936e700 1 --2- 172.21.15.115:0/1312628399 >> v2:172.21.15.156:3300/0 conn(0x7efe540a4140 0x7efe540670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:56.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe58b6d700 1 -- 172.21.15.115:0/1312628399 >> v2:172.21.15.156:3300/0 conn(0x7efe540a4140 msgr2=0x7efe540670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:05:56.901 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe58b6d700 1 --2- 172.21.15.115:0/1312628399 >> v2:172.21.15.156:3300/0 conn(0x7efe540a4140 0x7efe540670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:56.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe58b6d700 1 -- 172.21.15.115:0/1312628399 >> v1:172.21.15.156:6789/0 conn(0x7efe54067a20 legacy=0x7efe54067e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:56.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe58b6d700 1 -- 172.21.15.115:0/1312628399 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe540a4510 con 0x7efe5409d680 2023-09-29T23:05:56.902 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe58b6d700 1 --2- 172.21.15.115:0/1312628399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe5409d680 0x7efe5409da80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe5406a840 tx=0x7efe50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6cb48ca3d06275 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:56.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe4bfff700 1 -- 172.21.15.115:0/1312628399 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5000e070 con 0x7efe5409d680 2023-09-29T23:05:56.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe4bfff700 1 -- 172.21.15.115:0/1312628399 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5000bab0 con 0x7efe5409d680 2023-09-29T23:05:56.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.896+0000 7efe4bfff700 1 -- 172.21.15.115:0/1312628399 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500092e0 con 0x7efe5409d680 2023-09-29T23:05:56.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.900+0000 7efe5a370700 1 -- 172.21.15.115:0/1312628399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe5409d680 msgr2=0x7efe5409da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:56.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.900+0000 7efe5a370700 1 --2- 172.21.15.115:0/1312628399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe5409d680 0x7efe5409da80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe5406a840 tx=0x7efe50009840 comp rx=0 tx=0).stop 2023-09-29T23:05:56.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.900+0000 7efe5a370700 1 -- 172.21.15.115:0/1312628399 shutdown_connections 2023-09-29T23:05:56.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.900+0000 7efe5a370700 1 --2- 172.21.15.115:0/1312628399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe5409d680 0x7efe5409da80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:56.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.900+0000 7efe5a370700 1 --2- 172.21.15.115:0/1312628399 >> v2:172.21.15.156:3300/0 conn(0x7efe540a4140 0x7efe540670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:56.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.900+0000 7efe5a370700 1 -- 172.21.15.115:0/1312628399 >> 172.21.15.115:0/1312628399 conn(0x7efe540b1d20 msgr2=0x7efe540b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:56.903 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.900+0000 7efe5a370700 1 -- 172.21.15.115:0/1312628399 shutdown_connections 2023-09-29T23:05:56.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.900+0000 7efe5a370700 1 -- 172.21.15.115:0/1312628399 wait complete. 2023-09-29T23:05:56.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.900+0000 7efe5a370700 1 Processor -- start 2023-09-29T23:05:56.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.900+0000 7efe5a370700 1 -- start start 2023-09-29T23:05:56.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe5a370700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe54067a20 0x7efe540a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:56.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe5a370700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe5409d680 0x7efe54145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:56.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe5a370700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe540a4140 0x7efe54144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:56.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe5a370700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe54095900 con 0x7efe5409d680 2023-09-29T23:05:56.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe5a370700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe541468e0 con 0x7efe54067a20 2023-09-29T23:05:56.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe5a370700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe54146ba0 con 0x7efe540a4140 2023-09-29T23:05:56.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe59b6f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe540a4140 0x7efe54144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:56.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe58b6d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe5409d680 0x7efe54145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:56.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe59b6f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe540a4140 0x7efe54144b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:39954/0 (socket says 172.21.15.115:39954) 2023-09-29T23:05:56.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe59b6f700 1 -- 172.21.15.115:0/1798592698 learned_addr learned my addr 172.21.15.115:0/1798592698 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:05:56.907 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe5936e700 1 --2- 172.21.15.115:0/1798592698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe54067a20 0x7efe540a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:56.908 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe59b6f700 1 -- 172.21.15.115:0/1798592698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe54067a20 msgr2=0x7efe540a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:56.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe59b6f700 1 --2- 172.21.15.115:0/1798592698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe54067a20 0x7efe540a0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:56.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe59b6f700 1 -- 172.21.15.115:0/1798592698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe5409d680 msgr2=0x7efe54145f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:56.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe59b6f700 1 --2- 172.21.15.115:0/1798592698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe5409d680 0x7efe54145f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:56.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe59b6f700 1 -- 172.21.15.115:0/1798592698 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe50009ae0 con 0x7efe540a4140 2023-09-29T23:05:56.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe59b6f700 1 --2- 172.21.15.115:0/1798592698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe540a4140 0x7efe54144b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c560 tx=0x7efe4c007ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:56.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe497fa700 1 -- 172.21.15.115:0/1798592698 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c011590 con 0x7efe540a4140 2023-09-29T23:05:56.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe497fa700 1 -- 172.21.15.115:0/1798592698 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c0116f0 con 0x7efe540a4140 2023-09-29T23:05:56.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe5a370700 1 -- 172.21.15.115:0/1798592698 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe540a1200 con 0x7efe540a4140 2023-09-29T23:05:56.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe497fa700 1 -- 172.21.15.115:0/1798592698 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c011ab0 con 0x7efe540a4140 2023-09-29T23:05:56.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe5a370700 1 -- 172.21.15.115:0/1798592698 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe54145780 con 0x7efe540a4140 2023-09-29T23:05:56.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.904+0000 7efe5a370700 1 -- 172.21.15.115:0/1798592698 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe54095a70 con 0x7efe540a4140 2023-09-29T23:05:56.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.908+0000 7efe497fa700 1 -- 172.21.15.115:0/1798592698 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7efe4c01b3b0 con 0x7efe540a4140 2023-09-29T23:05:56.911 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.908+0000 7efe497fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:05:56.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.908+0000 7efe497fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:05:56.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.908+0000 7efe497fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:56.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.908+0000 7efe497fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:05:56.912 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.908+0000 7efe497fa700 1 --2- 172.21.15.115:0/1798592698 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efe3808e8b0 0x7efe38090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:05:56.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.908+0000 7efe497fa700 1 -- 172.21.15.115:0/1798592698 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7efe4c0b3f50 con 0x7efe540a4140 2023-09-29T23:05:56.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.908+0000 7efe5936e700 1 --2- 172.21.15.115:0/1798592698 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efe3808e8b0 0x7efe38090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:05:56.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.912+0000 7efe5936e700 1 --2- 172.21.15.115:0/1798592698 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efe3808e8b0 0x7efe38090d60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efe44009d10 tx=0x7efe440091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:05:56.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:56.916+0000 7efe497fa700 1 -- 172.21.15.115:0/1798592698 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efe4c0848f0 con 0x7efe540a4140 2023-09-29T23:05:57.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.112+0000 7efe5a370700 1 -- 172.21.15.115:0/1798592698 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efe540675e0 con 0x7efe540a4140 2023-09-29T23:05:57.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.112+0000 7efe497fa700 1 -- 172.21.15.115:0/1798592698 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7efe540675e0 con 0x7efe540a4140 2023-09-29T23:05:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:05:57.117 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:05:57.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.116+0000 7efe5a370700 10 mgrc shutdown 2023-09-29T23:05:57.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.116+0000 7efe5a370700 1 -- 172.21.15.115:0/1798592698 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efe3808e8b0 msgr2=0x7efe38090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:57.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.116+0000 7efe5a370700 1 --2- 172.21.15.115:0/1798592698 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efe3808e8b0 0x7efe38090d60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efe44009d10 tx=0x7efe440091a0 comp rx=0 tx=0).stop 2023-09-29T23:05:57.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.116+0000 7efe5a370700 1 -- 172.21.15.115:0/1798592698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe540a4140 msgr2=0x7efe54144b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:05:57.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.116+0000 7efe5a370700 1 --2- 172.21.15.115:0/1798592698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe540a4140 0x7efe54144b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c560 tx=0x7efe4c007ef0 comp rx=0 tx=0).stop 2023-09-29T23:05:57.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.116+0000 7efe5a370700 1 -- 172.21.15.115:0/1798592698 shutdown_connections 2023-09-29T23:05:57.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.116+0000 7efe5a370700 1 --2- 172.21.15.115:0/1798592698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe540a4140 0x7efe54144b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:57.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.116+0000 7efe5a370700 1 --2- 172.21.15.115:0/1798592698 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7efe3808e8b0 0x7efe38090d60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:57.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.116+0000 7efe5a370700 1 --2- 172.21.15.115:0/1798592698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe5409d680 0x7efe54145f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:57.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.116+0000 7efe5a370700 1 --2- 172.21.15.115:0/1798592698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe54067a20 0x7efe540a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:05:57.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.116+0000 7efe5a370700 1 -- 172.21.15.115:0/1798592698 >> 172.21.15.115:0/1798592698 conn(0x7efe540b1d20 msgr2=0x7efe540b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:05:57.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.116+0000 7efe5a370700 1 -- 172.21.15.115:0/1798592698 shutdown_connections 2023-09-29T23:05:57.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:05:57.116+0000 7efe5a370700 1 -- 172.21.15.115:0/1798592698 wait complete. 2023-09-29T23:06:00.132 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:00.247 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70e6c19700 1 Processor -- start 2023-09-29T23:06:00.248 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70e6c19700 1 -- start start 2023-09-29T23:06:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70e6c19700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f70e009b040 0x7f70e00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70e6c19700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f70e00a3bd0 0x7f70e014e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70e6c19700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e006fbe0 con 0x7f70e00a4d40 2023-09-29T23:06:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70e6c19700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e0141910 con 0x7f70e009b040 2023-09-29T23:06:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70e6c19700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e009b660 con 0x7f70e00a3bd0 2023-09-29T23:06:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70dffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f70e009b040 0x7f70e00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70dffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f70e009b040 0x7f70e00a3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58706/0 (socket says 172.21.15.115:58706) 2023-09-29T23:06:00.249 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70dffff700 1 -- 172.21.15.115:0/2457459060 learned_addr learned my addr 172.21.15.115:0/2457459060 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70e49b5700 1 --1- 172.21.15.115:0/2457459060 >> v1:172.21.15.115:6789/0 conn(0x7f70e00a4d40 0x7f70e0147450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:35896/0 (socket says 172.21.15.115:35896) 2023-09-29T23:06:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70e51b6700 1 --2- 172.21.15.115:0/2457459060 >> v2:172.21.15.156:3300/0 conn(0x7f70e00a3bd0 0x7f70e014e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70dffff700 1 -- 172.21.15.115:0/2457459060 >> v2:172.21.15.156:3300/0 conn(0x7f70e00a3bd0 msgr2=0x7f70e014e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70dffff700 1 --2- 172.21.15.115:0/2457459060 >> v2:172.21.15.156:3300/0 conn(0x7f70e00a3bd0 0x7f70e014e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70dffff700 1 -- 172.21.15.115:0/2457459060 >> v1:172.21.15.115:6789/0 conn(0x7f70e00a4d40 legacy=0x7f70e0147450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70dffff700 1 -- 172.21.15.115:0/2457459060 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00a5110 con 0x7f70e009b040 2023-09-29T23:06:00.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70dffff700 1 --2- 172.21.15.115:0/2457459060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e009b040 0x7f70e00a3690 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f70e009e800 tx=0x7f70cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00e4257f0159b57 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:00.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70df7fe700 1 -- 172.21.15.115:0/2457459060 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00b860 con 0x7f70e009b040 2023-09-29T23:06:00.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70df7fe700 1 -- 172.21.15.115:0/2457459060 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc00b9c0 con 0x7f70e009b040 2023-09-29T23:06:00.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.244+0000 7f70df7fe700 1 -- 172.21.15.115:0/2457459060 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00bd60 con 0x7f70e009b040 2023-09-29T23:06:00.251 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 -- 172.21.15.115:0/2457459060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e009b040 msgr2=0x7f70e00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 --2- 172.21.15.115:0/2457459060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e009b040 0x7f70e00a3690 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f70e009e800 tx=0x7f70cc009250 comp rx=0 tx=0).stop 2023-09-29T23:06:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 -- 172.21.15.115:0/2457459060 shutdown_connections 2023-09-29T23:06:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 --2- 172.21.15.115:0/2457459060 >> v2:172.21.15.156:3300/0 conn(0x7f70e00a3bd0 0x7f70e014e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 --2- 172.21.15.115:0/2457459060 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e009b040 0x7f70e00a3690 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 -- 172.21.15.115:0/2457459060 >> 172.21.15.115:0/2457459060 conn(0x7f70e00695c0 msgr2=0x7f70e00699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 -- 172.21.15.115:0/2457459060 shutdown_connections 2023-09-29T23:06:00.252 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 -- 172.21.15.115:0/2457459060 wait complete. 2023-09-29T23:06:00.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 Processor -- start 2023-09-29T23:06:00.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 -- start start 2023-09-29T23:06:00.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e009b040 0x7f70e006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:00.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e00a3bd0 0x7f70e01573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70e00a4d40 0x7f70e01578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e0158180 con 0x7f70e00a3bd0 2023-09-29T23:06:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00a10f0 con 0x7f70e00a4d40 2023-09-29T23:06:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.248+0000 7f70e6c19700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00a13d0 con 0x7f70e009b040 2023-09-29T23:06:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70dffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e00a3bd0 0x7f70e01573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70e49b5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e009b040 0x7f70e006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70e49b5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e009b040 0x7f70e006c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:39960/0 (socket says 172.21.15.115:39960) 2023-09-29T23:06:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70e49b5700 1 -- 172.21.15.115:0/1171640293 learned_addr learned my addr 172.21.15.115:0/1171640293 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70e51b6700 1 --2- 172.21.15.115:0/1171640293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70e00a4d40 0x7f70e01578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70e49b5700 1 -- 172.21.15.115:0/1171640293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70e00a4d40 msgr2=0x7f70e01578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:00.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70e49b5700 1 --2- 172.21.15.115:0/1171640293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70e00a4d40 0x7f70e01578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:00.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70e49b5700 1 -- 172.21.15.115:0/1171640293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e00a3bd0 msgr2=0x7f70e01573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:00.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70e49b5700 1 --2- 172.21.15.115:0/1171640293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e00a3bd0 0x7f70e01573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:00.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70e49b5700 1 -- 172.21.15.115:0/1171640293 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc0094f0 con 0x7f70e009b040 2023-09-29T23:06:00.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70e49b5700 1 --2- 172.21.15.115:0/1171640293 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e009b040 0x7f70e006c7c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70d400c590 tx=0x7f70d4007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:00.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70dcff9700 1 -- 172.21.15.115:0/1171640293 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4005a70 con 0x7f70e009b040 2023-09-29T23:06:00.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70dcff9700 1 -- 172.21.15.115:0/1171640293 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d4005bd0 con 0x7f70e009b040 2023-09-29T23:06:00.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70e6c19700 1 -- 172.21.15.115:0/1171640293 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e0157ec0 con 0x7f70e009b040 2023-09-29T23:06:00.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70dcff9700 1 -- 172.21.15.115:0/1171640293 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d40070d0 con 0x7f70e009b040 2023-09-29T23:06:00.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70e6c19700 1 -- 172.21.15.115:0/1171640293 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e009da70 con 0x7f70e009b040 2023-09-29T23:06:00.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.252+0000 7f70e6c19700 1 -- 172.21.15.115:0/1171640293 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e0070990 con 0x7f70e009b040 2023-09-29T23:06:00.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.256+0000 7f70dcff9700 1 -- 172.21.15.115:0/1171640293 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f70d4007440 con 0x7f70e009b040 2023-09-29T23:06:00.260 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.256+0000 7f70dcff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:00.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.256+0000 7f70dcff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:00.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.256+0000 7f70dcff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:00.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.256+0000 7f70dcff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:00.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.256+0000 7f70dcff9700 1 --2- 172.21.15.115:0/1171640293 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f70c408e8b0 0x7f70c4090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:00.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.260+0000 7f70dcff9700 1 -- 172.21.15.115:0/1171640293 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f70d40b3f10 con 0x7f70e009b040 2023-09-29T23:06:00.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.260+0000 7f70dffff700 1 --2- 172.21.15.115:0/1171640293 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f70c408e8b0 0x7f70c4090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:00.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.260+0000 7f70dffff700 1 --2- 172.21.15.115:0/1171640293 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f70c408e8b0 0x7f70c4090d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70e009e800 tx=0x7f70cc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:00.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.264+0000 7f70dcff9700 1 -- 172.21.15.115:0/1171640293 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f70d4084940 con 0x7f70e009b040 2023-09-29T23:06:00.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.460+0000 7f70e6c19700 1 -- 172.21.15.115:0/1171640293 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f70e00a1510 con 0x7f70e009b040 2023-09-29T23:06:00.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.460+0000 7f70dcff9700 1 -- 172.21.15.115:0/1171640293 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f70e00a1510 con 0x7f70e009b040 2023-09-29T23:06:00.464 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:00.464 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.464+0000 7f70e6c19700 10 mgrc shutdown 2023-09-29T23:06:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.464+0000 7f70e6c19700 1 -- 172.21.15.115:0/1171640293 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f70c408e8b0 msgr2=0x7f70c4090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.464+0000 7f70e6c19700 1 --2- 172.21.15.115:0/1171640293 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f70c408e8b0 0x7f70c4090d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70e009e800 tx=0x7f70cc017000 comp rx=0 tx=0).stop 2023-09-29T23:06:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.464+0000 7f70e6c19700 1 -- 172.21.15.115:0/1171640293 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e009b040 msgr2=0x7f70e006c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.464+0000 7f70e6c19700 1 --2- 172.21.15.115:0/1171640293 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e009b040 0x7f70e006c7c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70d400c590 tx=0x7f70d4007f90 comp rx=0 tx=0).stop 2023-09-29T23:06:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.464+0000 7f70e6c19700 1 -- 172.21.15.115:0/1171640293 shutdown_connections 2023-09-29T23:06:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.464+0000 7f70e6c19700 1 --2- 172.21.15.115:0/1171640293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70e00a4d40 0x7f70e01578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.464+0000 7f70e6c19700 1 --2- 172.21.15.115:0/1171640293 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f70c408e8b0 0x7f70c4090d60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.464+0000 7f70e6c19700 1 --2- 172.21.15.115:0/1171640293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70e00a3bd0 0x7f70e01573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.464+0000 7f70e6c19700 1 --2- 172.21.15.115:0/1171640293 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f70e009b040 0x7f70e006c7c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.464+0000 7f70e6c19700 1 -- 172.21.15.115:0/1171640293 >> 172.21.15.115:0/1171640293 conn(0x7f70e00695c0 msgr2=0x7f70e0067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.464+0000 7f70e6c19700 1 -- 172.21.15.115:0/1171640293 shutdown_connections 2023-09-29T23:06:00.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:00.464+0000 7f70e6c19700 1 -- 172.21.15.115:0/1171640293 wait complete. 2023-09-29T23:06:03.484 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 Processor -- start 2023-09-29T23:06:03.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 -- start start 2023-09-29T23:06:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8e9c0b3240 0x7f8e9c06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:03.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e9c13fe20 0x7f8e9c06f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9c06ef80 con 0x7f8e9c09f240 2023-09-29T23:06:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9c0a4900 con 0x7f8e9c0b3240 2023-09-29T23:06:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0b3610 con 0x7f8e9c13fe20 2023-09-29T23:06:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8e9affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8e9c0b3240 0x7f8e9c06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8e9b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8e9c09f240 0x7f8e9c0a34d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:35902/0 (socket says 172.21.15.115:35902) 2023-09-29T23:06:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8e9b7fe700 1 -- 172.21.15.115:0/1866450015 learned_addr learned my addr 172.21.15.115:0/1866450015 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:06:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8e9a7fc700 1 --2- 172.21.15.115:0/1866450015 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e9c13fe20 0x7f8e9c06f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8e9a7fc700 1 -- 172.21.15.115:0/1866450015 >> v2:172.21.15.115:3300/0 conn(0x7f8e9c0b3240 msgr2=0x7f8e9c06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8e9a7fc700 1 --2- 172.21.15.115:0/1866450015 >> v2:172.21.15.115:3300/0 conn(0x7f8e9c0b3240 0x7f8e9c06ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:03.601 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8e9a7fc700 1 -- 172.21.15.115:0/1866450015 >> v1:172.21.15.115:6789/0 conn(0x7f8e9c09f240 legacy=0x7f8e9c0a34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:03.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8e9a7fc700 1 -- 172.21.15.115:0/1866450015 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c06e310 con 0x7f8e9c13fe20 2023-09-29T23:06:03.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8e9affd700 1 --2- 172.21.15.115:0/1866450015 >> v2:172.21.15.115:3300/0 conn(0x7f8e9c0b3240 0x7f8e9c06ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:06:03.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8e9a7fc700 1 --2- 172.21.15.115:0/1866450015 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e9c13fe20 0x7f8e9c06f3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e900098e0 tx=0x7f8e900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f22ac7ede4b05f56 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:03.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8e99ffb700 1 -- 172.21.15.115:0/1866450015 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000f6b0 con 0x7f8e9c13fe20 2023-09-29T23:06:03.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8e99ffb700 1 -- 172.21.15.115:0/1866450015 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000f810 con 0x7f8e9c13fe20 2023-09-29T23:06:03.602 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8e99ffb700 1 -- 172.21.15.115:0/1866450015 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000fbb0 con 0x7f8e9c13fe20 2023-09-29T23:06:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 -- 172.21.15.115:0/1866450015 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e9c13fe20 msgr2=0x7f8e9c06f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 --2- 172.21.15.115:0/1866450015 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e9c13fe20 0x7f8e9c06f3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e900098e0 tx=0x7f8e900091a0 comp rx=0 tx=0).stop 2023-09-29T23:06:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 -- 172.21.15.115:0/1866450015 shutdown_connections 2023-09-29T23:06:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 --2- 172.21.15.115:0/1866450015 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e9c13fe20 0x7f8e9c06f3d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 --2- 172.21.15.115:0/1866450015 >> v2:172.21.15.115:3300/0 conn(0x7f8e9c0b3240 0x7f8e9c06ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 -- 172.21.15.115:0/1866450015 >> 172.21.15.115:0/1866450015 conn(0x7f8e9c068a40 msgr2=0x7f8e9c068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 -- 172.21.15.115:0/1866450015 shutdown_connections 2023-09-29T23:06:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.596+0000 7f8ea150c700 1 -- 172.21.15.115:0/1866450015 wait complete. 2023-09-29T23:06:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8ea150c700 1 Processor -- start 2023-09-29T23:06:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8ea150c700 1 -- start start 2023-09-29T23:06:03.605 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8ea150c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e9c09f240 0x7f8e9c0a2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8ea150c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e9c0b3240 0x7f8e9c09d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8ea150c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e9c13fe20 0x7f8e9c09d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8ea150c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c09dd50 con 0x7f8e9c0b3240 2023-09-29T23:06:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8ea150c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0a0b50 con 0x7f8e9c13fe20 2023-09-29T23:06:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8ea150c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c09ca60 con 0x7f8e9c09f240 2023-09-29T23:06:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e9affd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e9c09f240 0x7f8e9c0a2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e9affd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e9c09f240 0x7f8e9c0a2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:39978/0 (socket says 172.21.15.115:39978) 2023-09-29T23:06:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e9affd700 1 -- 172.21.15.115:0/835256001 learned_addr learned my addr 172.21.15.115:0/835256001 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e9a7fc700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e9c0b3240 0x7f8e9c09d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e9b7fe700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e9c13fe20 0x7f8e9c09d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e9affd700 1 -- 172.21.15.115:0/835256001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e9c13fe20 msgr2=0x7f8e9c09d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:03.606 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e9affd700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e9c13fe20 0x7f8e9c09d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e9affd700 1 -- 172.21.15.115:0/835256001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e9c0b3240 msgr2=0x7f8e9c09d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e9affd700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e9c0b3240 0x7f8e9c09d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e9affd700 1 -- 172.21.15.115:0/835256001 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e94009a20 con 0x7f8e9c09f240 2023-09-29T23:06:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e9b7fe700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e9c13fe20 0x7f8e9c09d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:06:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e9affd700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e9c09f240 0x7f8e9c0a2280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400c170 tx=0x7f8e9400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e82ffd700 1 -- 172.21.15.115:0/835256001 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400cd60 con 0x7f8e9c09f240 2023-09-29T23:06:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e82ffd700 1 -- 172.21.15.115:0/835256001 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9400f040 con 0x7f8e9c09f240 2023-09-29T23:06:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8e82ffd700 1 -- 172.21.15.115:0/835256001 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e94014690 con 0x7f8e9c09f240 2023-09-29T23:06:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8ea150c700 1 -- 172.21.15.115:0/835256001 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e90009420 con 0x7f8e9c09f240 2023-09-29T23:06:03.607 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.600+0000 7f8ea150c700 1 -- 172.21.15.115:0/835256001 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9c09fec0 con 0x7f8e9c09f240 2023-09-29T23:06:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.604+0000 7f8ea150c700 1 -- 172.21.15.115:0/835256001 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9c070990 con 0x7f8e9c09f240 2023-09-29T23:06:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.604+0000 7f8e82ffd700 1 -- 172.21.15.115:0/835256001 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f8e94014a40 con 0x7f8e9c09f240 2023-09-29T23:06:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.604+0000 7f8e82ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.604+0000 7f8e82ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:03.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.604+0000 7f8e82ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:03.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.604+0000 7f8e82ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:03.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.604+0000 7f8e82ffd700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8e8808e8b0 0x7f8e88090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:03.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.604+0000 7f8e82ffd700 1 -- 172.21.15.115:0/835256001 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f8e940b56e0 con 0x7f8e9c09f240 2023-09-29T23:06:03.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.604+0000 7f8e9a7fc700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8e8808e8b0 0x7f8e88090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:03.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.608+0000 7f8e9a7fc700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8e8808e8b0 0x7f8e88090d60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e900093f0 tx=0x7f8e90019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:03.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.612+0000 7f8e82ffd700 1 -- 172.21.15.115:0/835256001 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8e94086070 con 0x7f8e9c09f240 2023-09-29T23:06:03.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.804+0000 7f8ea150c700 1 -- 172.21.15.115:0/835256001 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8e9c09cf60 con 0x7f8e9c09f240 2023-09-29T23:06:03.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.804+0000 7f8e82ffd700 1 -- 172.21.15.115:0/835256001 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f8e9c09cf60 con 0x7f8e9c09f240 2023-09-29T23:06:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:03.809 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:03.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.808+0000 7f8ea150c700 10 mgrc shutdown 2023-09-29T23:06:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.808+0000 7f8ea150c700 1 -- 172.21.15.115:0/835256001 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8e8808e8b0 msgr2=0x7f8e88090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.808+0000 7f8ea150c700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8e8808e8b0 0x7f8e88090d60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e900093f0 tx=0x7f8e90019000 comp rx=0 tx=0).stop 2023-09-29T23:06:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.808+0000 7f8ea150c700 1 -- 172.21.15.115:0/835256001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e9c09f240 msgr2=0x7f8e9c0a2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.808+0000 7f8ea150c700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e9c09f240 0x7f8e9c0a2280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400c170 tx=0x7f8e9400b040 comp rx=0 tx=0).stop 2023-09-29T23:06:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.808+0000 7f8ea150c700 1 -- 172.21.15.115:0/835256001 shutdown_connections 2023-09-29T23:06:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.808+0000 7f8ea150c700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e9c13fe20 0x7f8e9c09d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.808+0000 7f8ea150c700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8e8808e8b0 0x7f8e88090d60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.808+0000 7f8ea150c700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e9c0b3240 0x7f8e9c09d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.808+0000 7f8ea150c700 1 --2- 172.21.15.115:0/835256001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e9c09f240 0x7f8e9c0a2280 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.808+0000 7f8ea150c700 1 -- 172.21.15.115:0/835256001 >> 172.21.15.115:0/835256001 conn(0x7f8e9c068a40 msgr2=0x7f8e9c09b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:03.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.808+0000 7f8ea150c700 1 -- 172.21.15.115:0/835256001 shutdown_connections 2023-09-29T23:06:03.813 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:03.808+0000 7f8ea150c700 1 -- 172.21.15.115:0/835256001 wait complete. 2023-09-29T23:06:06.824 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:06.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.932+0000 7f1e9fed6700 1 Processor -- start 2023-09-29T23:06:06.935 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.932+0000 7f1e9fed6700 1 -- start start 2023-09-29T23:06:06.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.932+0000 7f1e9fed6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e98068b70 0x7f1e9806d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:06.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.932+0000 7f1e9fed6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9813be40 con 0x7f1e980a4410 2023-09-29T23:06:06.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.932+0000 7f1e9fed6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e98068f40 con 0x7f1e9806f540 2023-09-29T23:06:06.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.932+0000 7f1e9fed6700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9806d9a0 con 0x7f1e98068b70 2023-09-29T23:06:06.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.932+0000 7f1e9e473700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1e980a4410 0x7f1e9813b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:52360/0 (socket says 172.21.15.115:52360) 2023-09-29T23:06:06.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.932+0000 7f1e9e473700 1 -- 172.21.15.115:0/2775378243 learned_addr learned my addr 172.21.15.115:0/2775378243 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:06:06.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.932+0000 7f1e9dc72700 1 --2- 172.21.15.115:0/2775378243 >> v2:172.21.15.156:3300/0 conn(0x7f1e98068b70 0x7f1e9806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:06.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.932+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360993707 0 0) 0x7f1e9813be40 con 0x7f1e980a4410 2023-09-29T23:06:06.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.932+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e84003570 con 0x7f1e980a4410 2023-09-29T23:06:06.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946850656 0 0) 0x7f1e98068f40 con 0x7f1e9806f540 2023-09-29T23:06:06.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e9813be40 con 0x7f1e9806f540 2023-09-29T23:06:06.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3669255457 0 0) 0x7f1e84003570 con 0x7f1e980a4410 2023-09-29T23:06:06.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 >> v2:172.21.15.156:3300/0 conn(0x7f1e98068b70 msgr2=0x7f1e9806d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:06.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 --2- 172.21.15.115:0/2775378243 >> v2:172.21.15.156:3300/0 conn(0x7f1e98068b70 0x7f1e9806d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:06.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 >> v1:172.21.15.156:6789/0 conn(0x7f1e9806f540 legacy=0x7f1e9806eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:06.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e980a4970 con 0x7f1e980a4410 2023-09-29T23:06:06.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3987234196 0 0) 0x7f1e900017f0 con 0x7f1e980a4410 2023-09-29T23:06:06.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 >> v1:172.21.15.115:6789/0 conn(0x7f1e980a4410 legacy=0x7f1e9813b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:06.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 --2- 172.21.15.115:0/2775378243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e84003bf0 0x7f1e84003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:06.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 --2- 172.21.15.115:0/2775378243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e84004810 0x7f1e84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:06.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 --2- 172.21.15.115:0/2775378243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e840051c0 0x7f1e8400cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:06.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9806d9a0 con 0x7f1e84003bf0 2023-09-29T23:06:06.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8400d1c0 con 0x7f1e84004810 2023-09-29T23:06:06.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8400d380 con 0x7f1e840051c0 2023-09-29T23:06:06.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9dc72700 1 --2- 172.21.15.115:0/2775378243 >> v2:172.21.15.156:3300/0 conn(0x7f1e98068b70 0x7f1e9806d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:06:06.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9e473700 1 --2- 172.21.15.115:0/2775378243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e840051c0 0x7f1e8400cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:06.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9dc72700 1 --2- 172.21.15.115:0/2775378243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e84003bf0 0x7f1e84003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:06.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9d471700 1 --2- 172.21.15.115:0/2775378243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e84004810 0x7f1e84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:06.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9dc72700 1 -- 172.21.15.115:0/2775378243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e840051c0 msgr2=0x7f1e8400cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:06.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9dc72700 1 --2- 172.21.15.115:0/2775378243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e840051c0 0x7f1e8400cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:06.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9dc72700 1 -- 172.21.15.115:0/2775378243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e84004810 msgr2=0x7f1e84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:06.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9dc72700 1 --2- 172.21.15.115:0/2775378243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e84004810 0x7f1e84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:06.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9dc72700 1 -- 172.21.15.115:0/2775378243 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84003570 con 0x7f1e84003bf0 2023-09-29T23:06:06.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9e473700 1 --2- 172.21.15.115:0/2775378243 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e840051c0 0x7f1e8400cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:06:06.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9d471700 1 --2- 172.21.15.115:0/2775378243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e84004810 0x7f1e84004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:06:06.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9e473700 1 -- 172.21.15.115:0/2775378243 reap_dead start 2023-09-29T23:06:06.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9dc72700 1 --2- 172.21.15.115:0/2775378243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e84003bf0 0x7f1e84003fe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009db0 tx=0x7f1e940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2670cd4ad5e2d4b server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:06.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e94009740 con 0x7f1e84003bf0 2023-09-29T23:06:06.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9400e920 con 0x7f1e84003bf0 2023-09-29T23:06:06.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9cc70700 1 -- 172.21.15.115:0/2775378243 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9400eca0 con 0x7f1e84003bf0 2023-09-29T23:06:06.943 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2775378243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e84003bf0 msgr2=0x7f1e84003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:06.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9fed6700 1 --2- 172.21.15.115:0/2775378243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e84003bf0 0x7f1e84003fe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009db0 tx=0x7f1e940091a0 comp rx=0 tx=0).stop 2023-09-29T23:06:06.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2775378243 shutdown_connections 2023-09-29T23:06:06.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9fed6700 1 --2- 172.21.15.115:0/2775378243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e84003bf0 0x7f1e84003fe0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:06.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2775378243 >> 172.21.15.115:0/2775378243 conn(0x7f1e9806a870 msgr2=0x7f1e980b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:06.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2775378243 shutdown_connections 2023-09-29T23:06:06.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.936+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2775378243 wait complete. 2023-09-29T23:06:06.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.940+0000 7f1e9fed6700 1 Processor -- start 2023-09-29T23:06:06.944 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.940+0000 7f1e9fed6700 1 -- start start 2023-09-29T23:06:06.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.940+0000 7f1e9fed6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e84003bf0 0x7f1e98142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:06.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.940+0000 7f1e9fed6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e98136c50 0x7f1e980a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:06.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.940+0000 7f1e9fed6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e9813e800 0x7f1e9813eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:06.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.940+0000 7f1e9fed6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e981422a0 con 0x7f1e98136c50 2023-09-29T23:06:06.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.940+0000 7f1e9fed6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9813e3d0 con 0x7f1e84003bf0 2023-09-29T23:06:06.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.940+0000 7f1e9fed6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9813f4b0 con 0x7f1e9813e800 2023-09-29T23:06:06.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.940+0000 7f1e9d471700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e98136c50 0x7f1e980a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:06.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.940+0000 7f1e9d471700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e98136c50 0x7f1e980a1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58560/0 (socket says 172.21.15.115:58560) 2023-09-29T23:06:06.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.940+0000 7f1e9e473700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e9813e800 0x7f1e9813eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:06.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.940+0000 7f1e9d471700 1 -- 172.21.15.115:0/2362976456 learned_addr learned my addr 172.21.15.115:0/2362976456 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:06.946 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.940+0000 7f1e9dc72700 1 --2- 172.21.15.115:0/2362976456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e84003bf0 0x7f1e98142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:06.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.944+0000 7f1e9d471700 1 -- 172.21.15.115:0/2362976456 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e9813e800 msgr2=0x7f1e9813eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:06.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.944+0000 7f1e9d471700 1 --2- 172.21.15.115:0/2362976456 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e9813e800 0x7f1e9813eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:06.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.944+0000 7f1e9d471700 1 -- 172.21.15.115:0/2362976456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e84003bf0 msgr2=0x7f1e98142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:06.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.944+0000 7f1e9d471700 1 --2- 172.21.15.115:0/2362976456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e84003bf0 0x7f1e98142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:06.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.944+0000 7f1e9d471700 1 -- 172.21.15.115:0/2362976456 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e98137430 con 0x7f1e98136c50 2023-09-29T23:06:06.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.944+0000 7f1e9d471700 1 --2- 172.21.15.115:0/2362976456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e98136c50 0x7f1e980a1a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1e88010a50 tx=0x7f1e88009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:06.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.944+0000 7f1e8dffb700 1 -- 172.21.15.115:0/2362976456 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88003d40 con 0x7f1e98136c50 2023-09-29T23:06:06.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.944+0000 7f1e8dffb700 1 -- 172.21.15.115:0/2362976456 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8800e990 con 0x7f1e98136c50 2023-09-29T23:06:06.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.944+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2362976456 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9813f1e0 con 0x7f1e98136c50 2023-09-29T23:06:06.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.944+0000 7f1e8dffb700 1 -- 172.21.15.115:0/2362976456 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8800ed50 con 0x7f1e98136c50 2023-09-29T23:06:06.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.944+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2362976456 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e981410c0 con 0x7f1e98136c50 2023-09-29T23:06:06.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.944+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2362976456 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e98070990 con 0x7f1e98136c50 2023-09-29T23:06:06.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.948+0000 7f1e8dffb700 1 -- 172.21.15.115:0/2362976456 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f1e88012660 con 0x7f1e98136c50 2023-09-29T23:06:06.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.948+0000 7f1e8dffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:06.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.948+0000 7f1e8dffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:06.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.948+0000 7f1e8dffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:06.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.948+0000 7f1e8dffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:06.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.948+0000 7f1e8dffb700 1 --2- 172.21.15.115:0/2362976456 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1e7c08e8b0 0x7f1e7c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:06.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.948+0000 7f1e8dffb700 1 -- 172.21.15.115:0/2362976456 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f1e880b7940 con 0x7f1e98136c50 2023-09-29T23:06:06.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.948+0000 7f1e9dc72700 1 --2- 172.21.15.115:0/2362976456 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1e7c08e8b0 0x7f1e7c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:06.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.948+0000 7f1e9dc72700 1 --2- 172.21.15.115:0/2362976456 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1e7c08e8b0 0x7f1e7c090d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1e940091e0 tx=0x7f1e94019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:06.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:06.952+0000 7f1e8dffb700 1 -- 172.21.15.115:0/2362976456 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1e88088370 con 0x7f1e98136c50 2023-09-29T23:06:07.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.148+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2362976456 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1e98067610 con 0x7f1e98136c50 2023-09-29T23:06:07.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.148+0000 7f1e8dffb700 1 -- 172.21.15.115:0/2362976456 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f1e8808b990 con 0x7f1e98136c50 2023-09-29T23:06:07.152 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:07.152 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:07.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.152+0000 7f1e9fed6700 10 mgrc shutdown 2023-09-29T23:06:07.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.152+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2362976456 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1e7c08e8b0 msgr2=0x7f1e7c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:07.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.152+0000 7f1e9fed6700 1 --2- 172.21.15.115:0/2362976456 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1e7c08e8b0 0x7f1e7c090d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1e940091e0 tx=0x7f1e94019000 comp rx=0 tx=0).stop 2023-09-29T23:06:07.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.152+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2362976456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e98136c50 msgr2=0x7f1e980a1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:07.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.152+0000 7f1e9fed6700 1 --2- 172.21.15.115:0/2362976456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e98136c50 0x7f1e980a1a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1e88010a50 tx=0x7f1e88009040 comp rx=0 tx=0).stop 2023-09-29T23:06:07.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.152+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2362976456 shutdown_connections 2023-09-29T23:06:07.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.152+0000 7f1e9fed6700 1 --2- 172.21.15.115:0/2362976456 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1e9813e800 0x7f1e9813eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:07.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.152+0000 7f1e9fed6700 1 --2- 172.21.15.115:0/2362976456 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1e7c08e8b0 0x7f1e7c090d60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:07.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.152+0000 7f1e9fed6700 1 --2- 172.21.15.115:0/2362976456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e98136c50 0x7f1e980a1a70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:07.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.152+0000 7f1e9fed6700 1 --2- 172.21.15.115:0/2362976456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e84003bf0 0x7f1e98142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:07.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.152+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2362976456 >> 172.21.15.115:0/2362976456 conn(0x7f1e9806a870 msgr2=0x7f1e980b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:07.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.152+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2362976456 shutdown_connections 2023-09-29T23:06:07.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:07.152+0000 7f1e9fed6700 1 -- 172.21.15.115:0/2362976456 wait complete. 2023-09-29T23:06:08.793 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:06:08.798 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:06:10.171 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:10.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c0759e700 1 Processor -- start 2023-09-29T23:06:10.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c0759e700 1 -- start start 2023-09-29T23:06:10.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c0759e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4c0806a550 0x7f4c0809d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:10.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c0759e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4c080677b0 0x7f4c081468a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:10.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c0759e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0809d800 con 0x7f4c0809dcc0 2023-09-29T23:06:10.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c0759e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0809c710 con 0x7f4c080677b0 2023-09-29T23:06:10.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c0759e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0809f5b0 con 0x7f4c0806a550 2023-09-29T23:06:10.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c06d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4c080677b0 0x7f4c081468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:10.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c0659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4c0809dcc0 0x7f4c080670a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:52370/0 (socket says 172.21.15.115:52370) 2023-09-29T23:06:10.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c06d9d700 1 --2- 172.21.15.115:0/3511998423 >> v2:172.21.15.115:3300/0 conn(0x7f4c080677b0 0x7f4c081468a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58568/0 (socket says 172.21.15.115:58568) 2023-09-29T23:06:10.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c0659c700 1 -- 172.21.15.115:0/3511998423 learned_addr learned my addr 172.21.15.115:0/3511998423 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:06:10.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c05d9b700 1 --2- 172.21.15.115:0/3511998423 >> v2:172.21.15.156:3300/0 conn(0x7f4c0806a550 0x7f4c0809d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:10.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c06d9d700 1 -- 172.21.15.115:0/3511998423 >> v2:172.21.15.156:3300/0 conn(0x7f4c0806a550 msgr2=0x7f4c0809d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:10.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c06d9d700 1 --2- 172.21.15.115:0/3511998423 >> v2:172.21.15.156:3300/0 conn(0x7f4c0806a550 0x7f4c0809d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:10.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c06d9d700 1 -- 172.21.15.115:0/3511998423 >> v1:172.21.15.115:6789/0 conn(0x7f4c0809dcc0 legacy=0x7f4c080670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:10.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c06d9d700 1 -- 172.21.15.115:0/3511998423 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0809f870 con 0x7f4c080677b0 2023-09-29T23:06:10.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c06d9d700 1 --2- 172.21.15.115:0/3511998423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c080677b0 0x7f4c081468a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4c0806b5c0 tx=0x7f4c000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deabb8463cf2ccc6 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:10.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c0559a700 1 -- 172.21.15.115:0/3511998423 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00011630 con 0x7f4c080677b0 2023-09-29T23:06:10.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c0559a700 1 -- 172.21.15.115:0/3511998423 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c00011790 con 0x7f4c080677b0 2023-09-29T23:06:10.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.280+0000 7f4c0559a700 1 -- 172.21.15.115:0/3511998423 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00011b30 con 0x7f4c080677b0 2023-09-29T23:06:10.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.284+0000 7f4c0759e700 1 -- 172.21.15.115:0/3511998423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c080677b0 msgr2=0x7f4c081468a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:10.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.284+0000 7f4c0759e700 1 --2- 172.21.15.115:0/3511998423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c080677b0 0x7f4c081468a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4c0806b5c0 tx=0x7f4c000091a0 comp rx=0 tx=0).stop 2023-09-29T23:06:10.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.284+0000 7f4c0759e700 1 -- 172.21.15.115:0/3511998423 shutdown_connections 2023-09-29T23:06:10.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.284+0000 7f4c0759e700 1 --2- 172.21.15.115:0/3511998423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c080677b0 0x7f4c081468a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:10.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.284+0000 7f4c0759e700 1 --2- 172.21.15.115:0/3511998423 >> v2:172.21.15.156:3300/0 conn(0x7f4c0806a550 0x7f4c0809d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:10.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.284+0000 7f4c0759e700 1 -- 172.21.15.115:0/3511998423 >> 172.21.15.115:0/3511998423 conn(0x7f4c080b1d20 msgr2=0x7f4c080b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:10.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.284+0000 7f4c0759e700 1 -- 172.21.15.115:0/3511998423 shutdown_connections 2023-09-29T23:06:10.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.284+0000 7f4c0759e700 1 -- 172.21.15.115:0/3511998423 wait complete. 2023-09-29T23:06:10.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.284+0000 7f4c0759e700 1 Processor -- start 2023-09-29T23:06:10.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.284+0000 7f4c0759e700 1 -- start start 2023-09-29T23:06:10.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c080677b0 0x7f4c0813c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:10.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0759e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c0806a550 0x7f4c0813d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:10.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c0809dcc0 0x7f4c08139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:10.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0759e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0813cfb0 con 0x7f4c080677b0 2023-09-29T23:06:10.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0759e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0813e090 con 0x7f4c0806a550 2023-09-29T23:06:10.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0813b070 con 0x7f4c0809dcc0 2023-09-29T23:06:10.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c080677b0 0x7f4c0813c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:10.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c080677b0 0x7f4c0813c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58570/0 (socket says 172.21.15.115:58570) 2023-09-29T23:06:10.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0659c700 1 -- 172.21.15.115:0/1487234710 learned_addr learned my addr 172.21.15.115:0/1487234710 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:10.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c06d9d700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c0809dcc0 0x7f4c08139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:10.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c05d9b700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c0806a550 0x7f4c0813d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:10.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0659c700 1 -- 172.21.15.115:0/1487234710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c0809dcc0 msgr2=0x7f4c08139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:10.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0659c700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c0809dcc0 0x7f4c08139940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:10.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0659c700 1 -- 172.21.15.115:0/1487234710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c0806a550 msgr2=0x7f4c0813d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:10.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0659c700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c0806a550 0x7f4c0813d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:10.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0659c700 1 -- 172.21.15.115:0/1487234710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00009420 con 0x7f4c080677b0 2023-09-29T23:06:10.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0659c700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c080677b0 0x7f4c0813c450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00c590 tx=0x7f4bfc007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:10.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4bf67fc700 1 -- 172.21.15.115:0/1487234710 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc005b30 con 0x7f4c080677b0 2023-09-29T23:06:10.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4bf67fc700 1 -- 172.21.15.115:0/1487234710 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc005cb0 con 0x7f4c080677b0 2023-09-29T23:06:10.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4bf67fc700 1 -- 172.21.15.115:0/1487234710 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc007320 con 0x7f4c080677b0 2023-09-29T23:06:10.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0759e700 1 -- 172.21.15.115:0/1487234710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0813c990 con 0x7f4c080677b0 2023-09-29T23:06:10.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.288+0000 7f4c0759e700 1 -- 172.21.15.115:0/1487234710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0813cc50 con 0x7f4c080677b0 2023-09-29T23:06:10.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.292+0000 7f4c0759e700 1 -- 172.21.15.115:0/1487234710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0804be00 con 0x7f4c080677b0 2023-09-29T23:06:10.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.292+0000 7f4bf67fc700 1 -- 172.21.15.115:0/1487234710 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f4bfc01b3b0 con 0x7f4c080677b0 2023-09-29T23:06:10.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.292+0000 7f4bf67fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:10.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.296+0000 7f4bf67fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:10.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.296+0000 7f4bf67fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:10.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.296+0000 7f4bf67fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:10.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.296+0000 7f4bf67fc700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4be808e8b0 0x7f4be8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:10.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.296+0000 7f4bf67fc700 1 -- 172.21.15.115:0/1487234710 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f4bfc0b3b20 con 0x7f4c080677b0 2023-09-29T23:06:10.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.296+0000 7f4c05d9b700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4be808e8b0 0x7f4be8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:10.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.296+0000 7f4c05d9b700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4be808e8b0 0x7f4be8090d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009fd0 tx=0x7f4bf800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:10.308 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.304+0000 7f4bf67fc700 1 -- 172.21.15.115:0/1487234710 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4bfc084530 con 0x7f4c080677b0 2023-09-29T23:06:10.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.500+0000 7f4c0759e700 1 -- 172.21.15.115:0/1487234710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4c0813ae50 con 0x7f4c080677b0 2023-09-29T23:06:10.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.500+0000 7f4bf67fc700 1 -- 172.21.15.115:0/1487234710 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f4bfc017080 con 0x7f4c080677b0 2023-09-29T23:06:10.505 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:10.505 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:10.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.504+0000 7f4c0759e700 10 mgrc shutdown 2023-09-29T23:06:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.504+0000 7f4c0759e700 1 -- 172.21.15.115:0/1487234710 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4be808e8b0 msgr2=0x7f4be8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.504+0000 7f4c0759e700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4be808e8b0 0x7f4be8090d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009fd0 tx=0x7f4bf800b040 comp rx=0 tx=0).stop 2023-09-29T23:06:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.504+0000 7f4c0759e700 1 -- 172.21.15.115:0/1487234710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c080677b0 msgr2=0x7f4c0813c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.504+0000 7f4c0759e700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c080677b0 0x7f4c0813c450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00c590 tx=0x7f4bfc007f90 comp rx=0 tx=0).stop 2023-09-29T23:06:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.504+0000 7f4c0759e700 1 -- 172.21.15.115:0/1487234710 shutdown_connections 2023-09-29T23:06:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.504+0000 7f4c0759e700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c0809dcc0 0x7f4c08139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.504+0000 7f4c0759e700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c0806a550 0x7f4c0813d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.504+0000 7f4c0759e700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4be808e8b0 0x7f4be8090d60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.504+0000 7f4c0759e700 1 --2- 172.21.15.115:0/1487234710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c080677b0 0x7f4c0813c450 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:10.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.504+0000 7f4c0759e700 1 -- 172.21.15.115:0/1487234710 >> 172.21.15.115:0/1487234710 conn(0x7f4c080b1d20 msgr2=0x7f4c08067b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:10.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.504+0000 7f4c0759e700 1 -- 172.21.15.115:0/1487234710 shutdown_connections 2023-09-29T23:06:10.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:10.504+0000 7f4c0759e700 1 -- 172.21.15.115:0/1487234710 wait complete. 2023-09-29T23:06:13.521 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:13.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 Processor -- start 2023-09-29T23:06:13.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 -- start start 2023-09-29T23:06:13.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a809fc60 0x7fc0a80a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:13.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0a813fe10 0x7fc0a8140270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:13.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a80a0030 con 0x7fc0a8142e50 2023-09-29T23:06:13.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a80a1ac0 con 0x7fc0a813fe10 2023-09-29T23:06:13.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a813fb70 con 0x7fc0a809fc60 2023-09-29T23:06:13.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ad775700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a809fc60 0x7fc0a80a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:13.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0acf74700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc0a8142e50 0x7fc0a81434f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:52372/0 (socket says 172.21.15.115:52372) 2023-09-29T23:06:13.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0acf74700 1 -- 172.21.15.115:0/835515818 learned_addr learned my addr 172.21.15.115:0/835515818 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:06:13.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0adf76700 1 --2- 172.21.15.115:0/835515818 >> v2:172.21.15.115:3300/0 conn(0x7fc0a813fe10 0x7fc0a8140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:13.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ad775700 1 -- 172.21.15.115:0/835515818 >> v2:172.21.15.115:3300/0 conn(0x7fc0a813fe10 msgr2=0x7fc0a8140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:13.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc09ffff700 1 -- 172.21.15.115:0/835515818 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382829600 0 0) 0x7fc0a80a0030 con 0x7fc0a8142e50 2023-09-29T23:06:13.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ad775700 1 --2- 172.21.15.115:0/835515818 >> v2:172.21.15.115:3300/0 conn(0x7fc0a813fe10 0x7fc0a8140270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:13.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ad775700 1 -- 172.21.15.115:0/835515818 >> v1:172.21.15.115:6789/0 conn(0x7fc0a8142e50 legacy=0x7fc0a81434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:13.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ad775700 1 -- 172.21.15.115:0/835515818 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a813f8d0 con 0x7fc0a809fc60 2023-09-29T23:06:13.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ad775700 1 --2- 172.21.15.115:0/835515818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a809fc60 0x7fc0a80a1580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40098e0 tx=0x7fc0a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e21972ee6152e55 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:13.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc09ffff700 1 -- 172.21.15.115:0/835515818 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4009e80 con 0x7fc0a809fc60 2023-09-29T23:06:13.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc09ffff700 1 -- 172.21.15.115:0/835515818 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a400b860 con 0x7fc0a809fc60 2023-09-29T23:06:13.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc09ffff700 1 -- 172.21.15.115:0/835515818 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400bbe0 con 0x7fc0a809fc60 2023-09-29T23:06:13.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 -- 172.21.15.115:0/835515818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a809fc60 msgr2=0x7fc0a80a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:13.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 --2- 172.21.15.115:0/835515818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a809fc60 0x7fc0a80a1580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40098e0 tx=0x7fc0a40091a0 comp rx=0 tx=0).stop 2023-09-29T23:06:13.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 -- 172.21.15.115:0/835515818 shutdown_connections 2023-09-29T23:06:13.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 --2- 172.21.15.115:0/835515818 >> v2:172.21.15.115:3300/0 conn(0x7fc0a813fe10 0x7fc0a8140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:13.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 --2- 172.21.15.115:0/835515818 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a809fc60 0x7fc0a80a1580 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:13.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 -- 172.21.15.115:0/835515818 >> 172.21.15.115:0/835515818 conn(0x7fc0a80b6c10 msgr2=0x7fc0a8067bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:13.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 -- 172.21.15.115:0/835515818 shutdown_connections 2023-09-29T23:06:13.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.632+0000 7fc0ae777700 1 -- 172.21.15.115:0/835515818 wait complete. 2023-09-29T23:06:13.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0ae777700 1 Processor -- start 2023-09-29T23:06:13.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0ae777700 1 -- start start 2023-09-29T23:06:13.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0ae777700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0a809fc60 0x7fc0a8141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:13.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0ae777700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a813fe10 0x7fc0a80a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:13.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0ae777700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a8142e50 0x7fc0a81527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:13.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0ae777700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80ab340 con 0x7fc0a8142e50 2023-09-29T23:06:13.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0ae777700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80aae70 con 0x7fc0a809fc60 2023-09-29T23:06:13.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0ae777700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80a3990 con 0x7fc0a813fe10 2023-09-29T23:06:13.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0acf74700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a813fe10 0x7fc0a80a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:13.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0adf76700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a8142e50 0x7fc0a81527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:13.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0acf74700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a813fe10 0x7fc0a80a2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:44738/0 (socket says 172.21.15.115:44738) 2023-09-29T23:06:13.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0acf74700 1 -- 172.21.15.115:0/650437421 learned_addr learned my addr 172.21.15.115:0/650437421 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:13.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0ad775700 1 --2- 172.21.15.115:0/650437421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0a809fc60 0x7fc0a8141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:13.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0acf74700 1 -- 172.21.15.115:0/650437421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0a809fc60 msgr2=0x7fc0a8141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:13.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0acf74700 1 --2- 172.21.15.115:0/650437421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0a809fc60 0x7fc0a8141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:13.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0acf74700 1 -- 172.21.15.115:0/650437421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a8142e50 msgr2=0x7fc0a81527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:13.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0acf74700 1 --2- 172.21.15.115:0/650437421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a8142e50 0x7fc0a81527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:13.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0acf74700 1 -- 172.21.15.115:0/650437421 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4009420 con 0x7fc0a813fe10 2023-09-29T23:06:13.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.636+0000 7fc0acf74700 1 --2- 172.21.15.115:0/650437421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a813fe10 0x7fc0a80a2f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000cc70 tx=0x7fc0a0001a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:13.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.640+0000 7fc09d7fa700 1 -- 172.21.15.115:0/650437421 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a000a940 con 0x7fc0a813fe10 2023-09-29T23:06:13.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.640+0000 7fc09d7fa700 1 -- 172.21.15.115:0/650437421 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a000aaa0 con 0x7fc0a813fe10 2023-09-29T23:06:13.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.640+0000 7fc0ae777700 1 -- 172.21.15.115:0/650437421 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a80a3c50 con 0x7fc0a813fe10 2023-09-29T23:06:13.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.640+0000 7fc09d7fa700 1 -- 172.21.15.115:0/650437421 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a000ae20 con 0x7fc0a813fe10 2023-09-29T23:06:13.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.640+0000 7fc0ae777700 1 -- 172.21.15.115:0/650437421 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a80a9c70 con 0x7fc0a813fe10 2023-09-29T23:06:13.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.640+0000 7fc0ae777700 1 -- 172.21.15.115:0/650437421 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a80ab060 con 0x7fc0a813fe10 2023-09-29T23:06:13.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.640+0000 7fc09d7fa700 1 -- 172.21.15.115:0/650437421 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc0a0007300 con 0x7fc0a813fe10 2023-09-29T23:06:13.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.640+0000 7fc09d7fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.644+0000 7fc09d7fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.644+0000 7fc09d7fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.644+0000 7fc09d7fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.644+0000 7fc09d7fa700 1 --2- 172.21.15.115:0/650437421 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc09408e8b0 0x7fc094090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.644+0000 7fc09d7fa700 1 -- 172.21.15.115:0/650437421 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fc0a00b53f0 con 0x7fc0a813fe10 2023-09-29T23:06:13.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.644+0000 7fc0ad775700 1 --2- 172.21.15.115:0/650437421 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc09408e8b0 0x7fc094090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:13.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.644+0000 7fc0ad775700 1 --2- 172.21.15.115:0/650437421 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc09408e8b0 0x7fc094090d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40091e0 tx=0x7fc0a4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:13.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.648+0000 7fc09d7fa700 1 -- 172.21.15.115:0/650437421 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc0a0085d90 con 0x7fc0a813fe10 2023-09-29T23:06:13.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 1 -- 172.21.15.115:0/650437421 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc0a80a9c70 con 0x7fc0a813fe10 2023-09-29T23:06:13.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc09d7fa700 1 -- 172.21.15.115:0/650437421 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fc0a80a9c70 con 0x7fc0a813fe10 2023-09-29T23:06:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:13.851 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:13.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 10 mgrc shutdown 2023-09-29T23:06:13.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 1 -- 172.21.15.115:0/650437421 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc09408e8b0 msgr2=0x7fc094090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:13.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 1 --2- 172.21.15.115:0/650437421 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc09408e8b0 0x7fc094090d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40091e0 tx=0x7fc0a4017000 comp rx=0 tx=0).stop 2023-09-29T23:06:13.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 1 -- 172.21.15.115:0/650437421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a813fe10 msgr2=0x7fc0a80a2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:13.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 1 --2- 172.21.15.115:0/650437421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a813fe10 0x7fc0a80a2f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000cc70 tx=0x7fc0a0001a30 comp rx=0 tx=0).stop 2023-09-29T23:06:13.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 1 -- 172.21.15.115:0/650437421 shutdown_connections 2023-09-29T23:06:13.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 1 --2- 172.21.15.115:0/650437421 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc09408e8b0 0x7fc094090d60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:13.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 1 --2- 172.21.15.115:0/650437421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a8142e50 0x7fc0a81527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:13.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 1 --2- 172.21.15.115:0/650437421 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a813fe10 0x7fc0a80a2f30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:13.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 1 --2- 172.21.15.115:0/650437421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0a809fc60 0x7fc0a8141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:13.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 1 -- 172.21.15.115:0/650437421 >> 172.21.15.115:0/650437421 conn(0x7fc0a80b6c10 msgr2=0x7fc0a80b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:13.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 1 -- 172.21.15.115:0/650437421 shutdown_connections 2023-09-29T23:06:13.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:13.848+0000 7fc0ae777700 1 -- 172.21.15.115:0/650437421 wait complete. 2023-09-29T23:06:16.865 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:17.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa61aa09700 1 Processor -- start 2023-09-29T23:06:17.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa61aa09700 1 -- start start 2023-09-29T23:06:17.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa61aa09700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa6140670a0 0x7fa614067a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:17.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa61aa09700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa614067f60 0x7fa61414e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:17.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa61aa09700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6140a3710 con 0x7fa6140a4140 2023-09-29T23:06:17.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa61aa09700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61409bd40 con 0x7fa614067f60 2023-09-29T23:06:17.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa61aa09700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6140a4510 con 0x7fa6140670a0 2023-09-29T23:06:17.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa619a07700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa6140a4140 0x7fa61409d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36204/0 (socket says 172.21.15.115:36204) 2023-09-29T23:06:17.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa619a07700 1 -- 172.21.15.115:0/3646966935 learned_addr learned my addr 172.21.15.115:0/3646966935 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:06:17.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa61a208700 1 --2- 172.21.15.115:0/3646966935 >> v2:172.21.15.115:3300/0 conn(0x7fa614067f60 0x7fa61414e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:17.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa619206700 1 --2- 172.21.15.115:0/3646966935 >> v2:172.21.15.156:3300/0 conn(0x7fa6140670a0 0x7fa614067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:17.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003946066 0 0) 0x7fa6140a3710 con 0x7fa6140a4140 2023-09-29T23:06:17.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa600003570 con 0x7fa6140a4140 2023-09-29T23:06:17.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2191352093 0 0) 0x7fa600003570 con 0x7fa6140a4140 2023-09-29T23:06:17.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 >> v2:172.21.15.156:3300/0 conn(0x7fa6140670a0 msgr2=0x7fa614067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:17.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 --2- 172.21.15.115:0/3646966935 >> v2:172.21.15.156:3300/0 conn(0x7fa6140670a0 0x7fa614067a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:17.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 >> v2:172.21.15.115:3300/0 conn(0x7fa614067f60 msgr2=0x7fa61414e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:17.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 --2- 172.21.15.115:0/3646966935 >> v2:172.21.15.115:3300/0 conn(0x7fa614067f60 0x7fa61414e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:17.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6140686b0 con 0x7fa6140a4140 2023-09-29T23:06:17.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3987234196 0 0) 0x7fa608001470 con 0x7fa6140a4140 2023-09-29T23:06:17.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 >> v1:172.21.15.115:6789/0 conn(0x7fa6140a4140 legacy=0x7fa61409d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:17.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 --2- 172.21.15.115:0/3646966935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa600003a60 0x7fa600003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:17.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 --2- 172.21.15.115:0/3646966935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa600004810 0x7fa600004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:17.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 --2- 172.21.15.115:0/3646966935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6000051c0 0x7fa60000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:17.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61409bd40 con 0x7fa600003a60 2023-09-29T23:06:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140a4510 con 0x7fa6000051c0 2023-09-29T23:06:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa619a07700 1 --2- 172.21.15.115:0/3646966935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa600003a60 0x7fa600003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60000bfa0 con 0x7fa600004810 2023-09-29T23:06:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa619206700 1 --2- 172.21.15.115:0/3646966935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa600004810 0x7fa600004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa61a208700 1 --2- 172.21.15.115:0/3646966935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6000051c0 0x7fa60000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa619a07700 1 -- 172.21.15.115:0/3646966935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa600004810 msgr2=0x7fa600004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa619a07700 1 --2- 172.21.15.115:0/3646966935 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa600004810 0x7fa600004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa619a07700 1 -- 172.21.15.115:0/3646966935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6000051c0 msgr2=0x7fa60000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa619a07700 1 --2- 172.21.15.115:0/3646966935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6000051c0 0x7fa60000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa61a208700 1 -- 172.21.15.115:0/3646966935 reap_dead start 2023-09-29T23:06:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa619a07700 1 -- 172.21.15.115:0/3646966935 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa600003570 con 0x7fa600003a60 2023-09-29T23:06:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa619a07700 1 --2- 172.21.15.115:0/3646966935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa600003a60 0x7fa600003e30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa608005230 tx=0x7fa608008cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1ee9c4688fe03e server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608004ba0 con 0x7fa600003a60 2023-09-29T23:06:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa608005920 con 0x7fa600003a60 2023-09-29T23:06:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.003+0000 7fa618a05700 1 -- 172.21.15.115:0/3646966935 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608005cc0 con 0x7fa600003a60 2023-09-29T23:06:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.007+0000 7fa61aa09700 1 -- 172.21.15.115:0/3646966935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa600003a60 msgr2=0x7fa600003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.007+0000 7fa61aa09700 1 --2- 172.21.15.115:0/3646966935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa600003a60 0x7fa600003e30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa608005230 tx=0x7fa608008cc0 comp rx=0 tx=0).stop 2023-09-29T23:06:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.007+0000 7fa61aa09700 1 -- 172.21.15.115:0/3646966935 shutdown_connections 2023-09-29T23:06:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.007+0000 7fa61aa09700 1 --2- 172.21.15.115:0/3646966935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa600003a60 0x7fa600003e30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.007+0000 7fa61aa09700 1 -- 172.21.15.115:0/3646966935 >> 172.21.15.115:0/3646966935 conn(0x7fa6140b1d20 msgr2=0x7fa6140b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.007+0000 7fa61aa09700 1 -- 172.21.15.115:0/3646966935 shutdown_connections 2023-09-29T23:06:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.007+0000 7fa61aa09700 1 -- 172.21.15.115:0/3646966935 wait complete. 2023-09-29T23:06:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.007+0000 7fa61aa09700 1 Processor -- start 2023-09-29T23:06:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.007+0000 7fa61aa09700 1 -- start start 2023-09-29T23:06:17.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.007+0000 7fa61aa09700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa600003a60 0x7fa614096530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:17.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.007+0000 7fa61aa09700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6140951d0 0x7fa6141534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:17.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa61aa09700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6140955c0 0x7fa61409f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:17.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa61aa09700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa614153f30 con 0x7fa6140951d0 2023-09-29T23:06:17.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa61aa09700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6141541f0 con 0x7fa6140955c0 2023-09-29T23:06:17.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa61aa09700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61406f690 con 0x7fa600003a60 2023-09-29T23:06:17.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa619206700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6140951d0 0x7fa6141534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:17.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa619a07700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa600003a60 0x7fa614096530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:17.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa619206700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6140951d0 0x7fa6141534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37646/0 (socket says 172.21.15.115:37646) 2023-09-29T23:06:17.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa619206700 1 -- 172.21.15.115:0/1120402513 learned_addr learned my addr 172.21.15.115:0/1120402513 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:17.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa61a208700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6140955c0 0x7fa61409f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:17.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa619206700 1 -- 172.21.15.115:0/1120402513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa600003a60 msgr2=0x7fa614096530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:17.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa619206700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa600003a60 0x7fa614096530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:17.018 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa619206700 1 -- 172.21.15.115:0/1120402513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6140955c0 msgr2=0x7fa61409f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa619206700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6140955c0 0x7fa61409f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa619206700 1 -- 172.21.15.115:0/1120402513 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa614096de0 con 0x7fa6140951d0 2023-09-29T23:06:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa619a07700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa600003a60 0x7fa614096530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:06:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa619206700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6140951d0 0x7fa6141534c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa610011d40 tx=0x7fa6100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa605ffb700 1 -- 172.21.15.115:0/1120402513 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000fa40 con 0x7fa6140951d0 2023-09-29T23:06:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa605ffb700 1 -- 172.21.15.115:0/1120402513 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61000fba0 con 0x7fa6140951d0 2023-09-29T23:06:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa61aa09700 1 -- 172.21.15.115:0/1120402513 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6140a0e00 con 0x7fa6140951d0 2023-09-29T23:06:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa605ffb700 1 -- 172.21.15.115:0/1120402513 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610014440 con 0x7fa6140951d0 2023-09-29T23:06:17.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa61aa09700 1 -- 172.21.15.115:0/1120402513 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa614153ba0 con 0x7fa6140951d0 2023-09-29T23:06:17.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.011+0000 7fa61aa09700 1 -- 172.21.15.115:0/1120402513 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61404be00 con 0x7fa6140951d0 2023-09-29T23:06:17.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.015+0000 7fa605ffb700 1 -- 172.21.15.115:0/1120402513 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fa610014870 con 0x7fa6140951d0 2023-09-29T23:06:17.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.015+0000 7fa605ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:17.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.015+0000 7fa605ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:17.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.015+0000 7fa605ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:17.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.015+0000 7fa605ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:17.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.015+0000 7fa605ffb700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa5f808e8b0 0x7fa5f8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:17.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.015+0000 7fa605ffb700 1 -- 172.21.15.115:0/1120402513 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fa610018030 con 0x7fa6140951d0 2023-09-29T23:06:17.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.015+0000 7fa619a07700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa5f808e8b0 0x7fa5f8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:17.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.015+0000 7fa619a07700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa5f808e8b0 0x7fa5f8090d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa608005230 tx=0x7fa608012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:17.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.019+0000 7fa605ffb700 1 -- 172.21.15.115:0/1120402513 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa610085c30 con 0x7fa6140951d0 2023-09-29T23:06:17.218 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 1 -- 172.21.15.115:0/1120402513 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa61406f980 con 0x7fa6140951d0 2023-09-29T23:06:17.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa605ffb700 1 -- 172.21.15.115:0/1120402513 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa610022080 con 0x7fa6140951d0 2023-09-29T23:06:17.219 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:17.219 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:17.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 10 mgrc shutdown 2023-09-29T23:06:17.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 1 -- 172.21.15.115:0/1120402513 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa5f808e8b0 msgr2=0x7fa5f8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:17.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa5f808e8b0 0x7fa5f8090d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa608005230 tx=0x7fa608012000 comp rx=0 tx=0).stop 2023-09-29T23:06:17.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 1 -- 172.21.15.115:0/1120402513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6140951d0 msgr2=0x7fa6141534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:17.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6140951d0 0x7fa6141534c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa610011d40 tx=0x7fa6100091a0 comp rx=0 tx=0).stop 2023-09-29T23:06:17.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 1 -- 172.21.15.115:0/1120402513 shutdown_connections 2023-09-29T23:06:17.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6140955c0 0x7fa61409f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:17.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa5f808e8b0 0x7fa5f8090d60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:17.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6140951d0 0x7fa6141534c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:17.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 1 --2- 172.21.15.115:0/1120402513 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa600003a60 0x7fa614096530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:17.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 1 -- 172.21.15.115:0/1120402513 >> 172.21.15.115:0/1120402513 conn(0x7fa6140b1d20 msgr2=0x7fa6140692e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:17.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 1 -- 172.21.15.115:0/1120402513 shutdown_connections 2023-09-29T23:06:17.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:17.215+0000 7fa61aa09700 1 -- 172.21.15.115:0/1120402513 wait complete. 2023-09-29T23:06:20.234 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:20.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.343+0000 7f892ffff700 1 Processor -- start 2023-09-29T23:06:20.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.343+0000 7f892ffff700 1 -- start start 2023-09-29T23:06:20.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f89300a4140 0x7f89300670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f893009d680 0x7f893009da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930067a20 0x7f8930067e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89300675e0 con 0x7f89300a4140 2023-09-29T23:06:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89300a3710 con 0x7f893009d680 2023-09-29T23:06:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893009bd40 con 0x7f8930067a20 2023-09-29T23:06:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f89300a4140 0x7f89300670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930067a20 0x7f8930067e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930067a20 0x7f8930067e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:35462/0 (socket says 172.21.15.115:35462) 2023-09-29T23:06:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f89300a4140 0x7f89300670a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37654/0 (socket says 172.21.15.115:37654) 2023-09-29T23:06:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892f7fe700 1 -- 172.21.15.115:0/4282912312 learned_addr learned my addr 172.21.15.115:0/4282912312 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:20.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892e7fc700 1 --2- 172.21.15.115:0/4282912312 >> v2:172.21.15.156:3300/0 conn(0x7f893009d680 0x7f893009da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:20.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892effd700 1 -- 172.21.15.115:0/4282912312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930067a20 msgr2=0x7f8930067e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:20.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892effd700 1 --2- 172.21.15.115:0/4282912312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930067a20 0x7f8930067e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:20.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892effd700 1 -- 172.21.15.115:0/4282912312 >> v2:172.21.15.156:3300/0 conn(0x7f893009d680 msgr2=0x7f893009da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892effd700 1 --2- 172.21.15.115:0/4282912312 >> v2:172.21.15.156:3300/0 conn(0x7f893009d680 0x7f893009da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892effd700 1 -- 172.21.15.115:0/4282912312 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89300a4510 con 0x7f89300a4140 2023-09-29T23:06:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892f7fe700 1 --2- 172.21.15.115:0/4282912312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930067a20 0x7f8930067e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:06:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892effd700 1 --2- 172.21.15.115:0/4282912312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89300a4140 0x7f89300670a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f893006a3b0 tx=0x7f89180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f238c9171597fd server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892dffb700 1 -- 172.21.15.115:0/4282912312 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918011630 con 0x7f89300a4140 2023-09-29T23:06:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892dffb700 1 -- 172.21.15.115:0/4282912312 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89180117b0 con 0x7f89300a4140 2023-09-29T23:06:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892dffb700 1 -- 172.21.15.115:0/4282912312 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918011b70 con 0x7f89300a4140 2023-09-29T23:06:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 -- 172.21.15.115:0/4282912312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89300a4140 msgr2=0x7f89300670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 --2- 172.21.15.115:0/4282912312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89300a4140 0x7f89300670a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f893006a3b0 tx=0x7f89180091a0 comp rx=0 tx=0).stop 2023-09-29T23:06:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 -- 172.21.15.115:0/4282912312 shutdown_connections 2023-09-29T23:06:20.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 --2- 172.21.15.115:0/4282912312 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930067a20 0x7f8930067e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:20.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 --2- 172.21.15.115:0/4282912312 >> v2:172.21.15.156:3300/0 conn(0x7f893009d680 0x7f893009da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:20.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 --2- 172.21.15.115:0/4282912312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89300a4140 0x7f89300670a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:20.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 -- 172.21.15.115:0/4282912312 >> 172.21.15.115:0/4282912312 conn(0x7f89300b1d20 msgr2=0x7f89300b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:20.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 -- 172.21.15.115:0/4282912312 shutdown_connections 2023-09-29T23:06:20.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.347+0000 7f892ffff700 1 -- 172.21.15.115:0/4282912312 wait complete. 2023-09-29T23:06:20.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.351+0000 7f892ffff700 1 Processor -- start 2023-09-29T23:06:20.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.351+0000 7f892ffff700 1 -- start start 2023-09-29T23:06:20.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.351+0000 7f892ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930067a20 0x7f893006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:20.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.351+0000 7f892ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f893009d680 0x7f8930152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:20.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.351+0000 7f892ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89300a4140 0x7f8930153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:20.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.351+0000 7f892ffff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893006ec60 con 0x7f893009d680 2023-09-29T23:06:20.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.351+0000 7f892ffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8930157530 con 0x7f89300a4140 2023-09-29T23:06:20.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.351+0000 7f892ffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89301577f0 con 0x7f8930067a20 2023-09-29T23:06:20.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892e7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f893009d680 0x7f8930152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:20.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892effd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930067a20 0x7f893006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892effd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930067a20 0x7f893006d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:35472/0 (socket says 172.21.15.115:35472) 2023-09-29T23:06:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892e7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f893009d680 0x7f8930152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37656/0 (socket says 172.21.15.115:37656) 2023-09-29T23:06:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892effd700 1 -- 172.21.15.115:0/327700466 learned_addr learned my addr 172.21.15.115:0/327700466 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892f7fe700 1 --2- 172.21.15.115:0/327700466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89300a4140 0x7f8930153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892e7fc700 1 -- 172.21.15.115:0/327700466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930067a20 msgr2=0x7f893006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892e7fc700 1 --2- 172.21.15.115:0/327700466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930067a20 0x7f893006d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892e7fc700 1 -- 172.21.15.115:0/327700466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89300a4140 msgr2=0x7f8930153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892e7fc700 1 --2- 172.21.15.115:0/327700466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89300a4140 0x7f8930153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892e7fc700 1 -- 172.21.15.115:0/327700466 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280094f0 con 0x7f893009d680 2023-09-29T23:06:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892e7fc700 1 --2- 172.21.15.115:0/327700466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f893009d680 0x7f8930152ed0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8920009ef0 tx=0x7f892000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f8926ffd700 1 -- 172.21.15.115:0/327700466 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000cb70 con 0x7f893009d680 2023-09-29T23:06:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f8926ffd700 1 -- 172.21.15.115:0/327700466 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892000f040 con 0x7f893009d680 2023-09-29T23:06:20.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892ffff700 1 -- 172.21.15.115:0/327700466 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8918009420 con 0x7f893009d680 2023-09-29T23:06:20.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f8926ffd700 1 -- 172.21.15.115:0/327700466 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8920014480 con 0x7f893009d680 2023-09-29T23:06:20.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892ffff700 1 -- 172.21.15.115:0/327700466 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893009eb70 con 0x7f893009d680 2023-09-29T23:06:20.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.355+0000 7f892ffff700 1 -- 172.21.15.115:0/327700466 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893006edf0 con 0x7f893009d680 2023-09-29T23:06:20.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.359+0000 7f8926ffd700 1 -- 172.21.15.115:0/327700466 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f8920014830 con 0x7f893009d680 2023-09-29T23:06:20.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.359+0000 7f8926ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:20.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.359+0000 7f8926ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:20.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.359+0000 7f8926ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:20.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.359+0000 7f8926ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:20.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.359+0000 7f8926ffd700 1 --2- 172.21.15.115:0/327700466 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f891008e830 0x7f8910090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:20.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.359+0000 7f8926ffd700 1 -- 172.21.15.115:0/327700466 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f89200b5ac0 con 0x7f893009d680 2023-09-29T23:06:20.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.359+0000 7f892effd700 1 --2- 172.21.15.115:0/327700466 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f891008e830 0x7f8910090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:20.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.359+0000 7f892effd700 1 --2- 172.21.15.115:0/327700466 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f891008e830 0x7f8910090ce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8918011fd0 tx=0x7f8918017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:20.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.363+0000 7f8926ffd700 1 -- 172.21.15.115:0/327700466 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8920052be0 con 0x7f893009d680 2023-09-29T23:06:20.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 1 -- 172.21.15.115:0/327700466 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f893004be00 con 0x7f893009d680 2023-09-29T23:06:20.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f8926ffd700 1 -- 172.21.15.115:0/327700466 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f892008c080 con 0x7f893009d680 2023-09-29T23:06:20.563 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:20.563 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:20.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 10 mgrc shutdown 2023-09-29T23:06:20.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 1 -- 172.21.15.115:0/327700466 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f891008e830 msgr2=0x7f8910090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:20.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 1 --2- 172.21.15.115:0/327700466 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f891008e830 0x7f8910090ce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8918011fd0 tx=0x7f8918017000 comp rx=0 tx=0).stop 2023-09-29T23:06:20.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 1 -- 172.21.15.115:0/327700466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f893009d680 msgr2=0x7f8930152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:20.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 1 --2- 172.21.15.115:0/327700466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f893009d680 0x7f8930152ed0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8920009ef0 tx=0x7f892000b040 comp rx=0 tx=0).stop 2023-09-29T23:06:20.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 1 -- 172.21.15.115:0/327700466 shutdown_connections 2023-09-29T23:06:20.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 1 --2- 172.21.15.115:0/327700466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89300a4140 0x7f8930153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:20.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 1 --2- 172.21.15.115:0/327700466 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f891008e830 0x7f8910090ce0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:20.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 1 --2- 172.21.15.115:0/327700466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f893009d680 0x7f8930152ed0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:20.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 1 --2- 172.21.15.115:0/327700466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8930067a20 0x7f893006d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:20.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 1 -- 172.21.15.115:0/327700466 >> 172.21.15.115:0/327700466 conn(0x7f89300b1d20 msgr2=0x7f89300b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:20.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 1 -- 172.21.15.115:0/327700466 shutdown_connections 2023-09-29T23:06:20.566 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:20.559+0000 7f892ffff700 1 -- 172.21.15.115:0/327700466 wait complete. 2023-09-29T23:06:23.577 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:23.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.683+0000 7f982d14b700 1 Processor -- start 2023-09-29T23:06:23.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.683+0000 7f982d14b700 1 -- start start 2023-09-29T23:06:23.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.683+0000 7f982d14b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9828067b60 0x7f982809d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:23.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.683+0000 7f982d14b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98280a4120 0x7f982809bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:23.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.683+0000 7f982d14b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f982813fb10 0x7f982813ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:23.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.683+0000 7f982d14b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982809ce00 con 0x7f982813fb10 2023-09-29T23:06:23.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.683+0000 7f982d14b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9828067f30 con 0x7f9828067b60 2023-09-29T23:06:23.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.683+0000 7f982d14b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982809d970 con 0x7f98280a4120 2023-09-29T23:06:23.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f98277fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98280a4120 0x7f982809bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:23.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f98277fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98280a4120 0x7f982809bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:35488/0 (socket says 172.21.15.115:35488) 2023-09-29T23:06:23.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f98277fe700 1 -- 172.21.15.115:0/2730239130 learned_addr learned my addr 172.21.15.115:0/2730239130 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:23.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f982c94a700 1 --2- 172.21.15.115:0/2730239130 >> v2:172.21.15.115:3300/0 conn(0x7f982813fb10 0x7f982813ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:23.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f9827fff700 1 --2- 172.21.15.115:0/2730239130 >> v2:172.21.15.156:3300/0 conn(0x7f9828067b60 0x7f982809d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:23.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f98277fe700 1 -- 172.21.15.115:0/2730239130 >> v2:172.21.15.156:3300/0 conn(0x7f9828067b60 msgr2=0x7f982809d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:23.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f98277fe700 1 --2- 172.21.15.115:0/2730239130 >> v2:172.21.15.156:3300/0 conn(0x7f9828067b60 0x7f982809d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:23.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f98277fe700 1 -- 172.21.15.115:0/2730239130 >> v2:172.21.15.115:3300/0 conn(0x7f982813fb10 msgr2=0x7f982813ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:23.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f98277fe700 1 --2- 172.21.15.115:0/2730239130 >> v2:172.21.15.115:3300/0 conn(0x7f982813fb10 0x7f982813ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:23.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f98277fe700 1 -- 172.21.15.115:0/2730239130 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982809dc10 con 0x7f98280a4120 2023-09-29T23:06:23.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f98277fe700 1 --2- 172.21.15.115:0/2730239130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98280a4120 0x7f982809bf20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f982809de00 tx=0x7f9818009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25fa85cc2ce2bb39 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:23.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f9826ffd700 1 -- 172.21.15.115:0/2730239130 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9818011630 con 0x7f98280a4120 2023-09-29T23:06:23.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f9826ffd700 1 -- 172.21.15.115:0/2730239130 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9818011790 con 0x7f98280a4120 2023-09-29T23:06:23.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f9826ffd700 1 -- 172.21.15.115:0/2730239130 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9818011b50 con 0x7f98280a4120 2023-09-29T23:06:23.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f982d14b700 1 -- 172.21.15.115:0/2730239130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98280a4120 msgr2=0x7f982809bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:23.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f982d14b700 1 --2- 172.21.15.115:0/2730239130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98280a4120 0x7f982809bf20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f982809de00 tx=0x7f9818009250 comp rx=0 tx=0).stop 2023-09-29T23:06:23.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f982d14b700 1 -- 172.21.15.115:0/2730239130 shutdown_connections 2023-09-29T23:06:23.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f982d14b700 1 --2- 172.21.15.115:0/2730239130 >> v2:172.21.15.115:3300/0 conn(0x7f982813fb10 0x7f982813ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:23.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f982d14b700 1 --2- 172.21.15.115:0/2730239130 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98280a4120 0x7f982809bf20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:23.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f982d14b700 1 --2- 172.21.15.115:0/2730239130 >> v2:172.21.15.156:3300/0 conn(0x7f9828067b60 0x7f982809d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:23.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f982d14b700 1 -- 172.21.15.115:0/2730239130 >> 172.21.15.115:0/2730239130 conn(0x7f98280b1d20 msgr2=0x7f98280b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:23.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f982d14b700 1 -- 172.21.15.115:0/2730239130 shutdown_connections 2023-09-29T23:06:23.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.687+0000 7f982d14b700 1 -- 172.21.15.115:0/2730239130 wait complete. 2023-09-29T23:06:23.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982d14b700 1 Processor -- start 2023-09-29T23:06:23.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982d14b700 1 -- start start 2023-09-29T23:06:23.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982d14b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9828067b60 0x7f9828096a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982d14b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98280a4120 0x7f9828094f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982d14b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982813fb10 0x7f98281388e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982d14b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982813c690 con 0x7f982813fb10 2023-09-29T23:06:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982d14b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9828097200 con 0x7f9828067b60 2023-09-29T23:06:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982d14b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9828096310 con 0x7f98280a4120 2023-09-29T23:06:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982c94a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982813fb10 0x7f98281388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f98277fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98280a4120 0x7f9828094f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982c94a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982813fb10 0x7f98281388e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37670/0 (socket says 172.21.15.115:37670) 2023-09-29T23:06:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982c94a700 1 -- 172.21.15.115:0/4111706841 learned_addr learned my addr 172.21.15.115:0/4111706841 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f9827fff700 1 --2- 172.21.15.115:0/4111706841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9828067b60 0x7f9828096a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982c94a700 1 -- 172.21.15.115:0/4111706841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98280a4120 msgr2=0x7f9828094f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982c94a700 1 --2- 172.21.15.115:0/4111706841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98280a4120 0x7f9828094f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:23.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982c94a700 1 -- 172.21.15.115:0/4111706841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9828067b60 msgr2=0x7f9828096a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:23.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982c94a700 1 --2- 172.21.15.115:0/4111706841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9828067b60 0x7f9828096a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:23.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982c94a700 1 -- 172.21.15.115:0/4111706841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98180094f0 con 0x7f982813fb10 2023-09-29T23:06:23.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982c94a700 1 --2- 172.21.15.115:0/4111706841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982813fb10 0x7f98281388e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9820009df0 tx=0x7f982000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:23.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f980ffff700 1 -- 172.21.15.115:0/4111706841 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000caa0 con 0x7f982813fb10 2023-09-29T23:06:23.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f980ffff700 1 -- 172.21.15.115:0/4111706841 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982000f040 con 0x7f982813fb10 2023-09-29T23:06:23.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982d14b700 1 -- 172.21.15.115:0/4111706841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98280959a0 con 0x7f982813fb10 2023-09-29T23:06:23.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f980ffff700 1 -- 172.21.15.115:0/4111706841 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000ce70 con 0x7f982813fb10 2023-09-29T23:06:23.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.691+0000 7f982d14b700 1 -- 172.21.15.115:0/4111706841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9828096030 con 0x7f982813fb10 2023-09-29T23:06:23.699 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.695+0000 7f982d14b700 1 -- 172.21.15.115:0/4111706841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9828096fe0 con 0x7f982813fb10 2023-09-29T23:06:23.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.695+0000 7f980ffff700 1 -- 172.21.15.115:0/4111706841 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f9820014690 con 0x7f982813fb10 2023-09-29T23:06:23.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.695+0000 7f980ffff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:23.700 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.695+0000 7f980ffff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:23.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.695+0000 7f980ffff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:23.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.695+0000 7f980ffff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:23.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.695+0000 7f980ffff700 1 --2- 172.21.15.115:0/4111706841 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f981408e8b0 0x7f9814090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:23.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.695+0000 7f980ffff700 1 -- 172.21.15.115:0/4111706841 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f98200b57d0 con 0x7f982813fb10 2023-09-29T23:06:23.701 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.695+0000 7f9827fff700 1 --2- 172.21.15.115:0/4111706841 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f981408e8b0 0x7f9814090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:23.702 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.699+0000 7f9827fff700 1 --2- 172.21.15.115:0/4111706841 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f981408e8b0 0x7f9814090d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f981c009db0 tx=0x7f981c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:23.707 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.703+0000 7f980ffff700 1 -- 172.21.15.115:0/4111706841 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9820089c00 con 0x7f982813fb10 2023-09-29T23:06:23.904 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.899+0000 7f982d14b700 1 -- 172.21.15.115:0/4111706841 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f982804be00 con 0x7f982813fb10 2023-09-29T23:06:23.905 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.899+0000 7f980ffff700 1 -- 172.21.15.115:0/4111706841 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f9820018080 con 0x7f982813fb10 2023-09-29T23:06:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:23.905 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.903+0000 7f982d14b700 10 mgrc shutdown 2023-09-29T23:06:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.903+0000 7f982d14b700 1 -- 172.21.15.115:0/4111706841 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f981408e8b0 msgr2=0x7f9814090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.903+0000 7f982d14b700 1 --2- 172.21.15.115:0/4111706841 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f981408e8b0 0x7f9814090d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f981c009db0 tx=0x7f981c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:06:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.903+0000 7f982d14b700 1 -- 172.21.15.115:0/4111706841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982813fb10 msgr2=0x7f98281388e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.903+0000 7f982d14b700 1 --2- 172.21.15.115:0/4111706841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982813fb10 0x7f98281388e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9820009df0 tx=0x7f982000b040 comp rx=0 tx=0).stop 2023-09-29T23:06:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.903+0000 7f982d14b700 1 -- 172.21.15.115:0/4111706841 shutdown_connections 2023-09-29T23:06:23.909 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.903+0000 7f982d14b700 1 --2- 172.21.15.115:0/4111706841 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f981408e8b0 0x7f9814090d60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:23.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.903+0000 7f982d14b700 1 --2- 172.21.15.115:0/4111706841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f982813fb10 0x7f98281388e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:23.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.903+0000 7f982d14b700 1 --2- 172.21.15.115:0/4111706841 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98280a4120 0x7f9828094f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:23.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.903+0000 7f982d14b700 1 --2- 172.21.15.115:0/4111706841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9828067b60 0x7f9828096a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:23.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.903+0000 7f982d14b700 1 -- 172.21.15.115:0/4111706841 >> 172.21.15.115:0/4111706841 conn(0x7f98280b1d20 msgr2=0x7f982809eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:23.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.903+0000 7f982d14b700 1 -- 172.21.15.115:0/4111706841 shutdown_connections 2023-09-29T23:06:23.910 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:23.903+0000 7f982d14b700 1 -- 172.21.15.115:0/4111706841 wait complete. 2023-09-29T23:06:26.925 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:27.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.031+0000 7f228a1aa700 1 Processor -- start 2023-09-29T23:06:27.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.031+0000 7f228a1aa700 1 -- start start 2023-09-29T23:06:27.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.031+0000 7f228a1aa700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2284142e50 0x7f22841434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:27.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.031+0000 7f228a1aa700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22840a0030 con 0x7f2284143a30 2023-09-29T23:06:27.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.031+0000 7f228a1aa700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228413fb70 con 0x7f228409fc60 2023-09-29T23:06:27.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.031+0000 7f228a1aa700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228413f8d0 con 0x7f2284142e50 2023-09-29T23:06:27.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.031+0000 7f22889a7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2284142e50 0x7f22841434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:27.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.031+0000 7f22889a7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2284142e50 0x7f22841434f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54126/0 (socket says 172.21.15.115:54126) 2023-09-29T23:06:27.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.031+0000 7f22889a7700 1 -- 172.21.15.115:0/1107404787 learned_addr learned my addr 172.21.15.115:0/1107404787 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:27.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.031+0000 7f22899a9700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2284143a30 0x7f228413fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50456/0 (socket says 172.21.15.115:50456) 2023-09-29T23:06:27.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.031+0000 7f22889a7700 1 -- 172.21.15.115:0/1107404787 >> v1:172.21.15.156:6789/0 conn(0x7f228409fc60 legacy=0x7f22840a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:27.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.031+0000 7f22889a7700 1 -- 172.21.15.115:0/1107404787 >> v1:172.21.15.115:6789/0 conn(0x7f2284143a30 legacy=0x7f228413fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:27.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.031+0000 7f22889a7700 1 -- 172.21.15.115:0/1107404787 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2284140520 con 0x7f2284142e50 2023-09-29T23:06:27.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.035+0000 7f22889a7700 1 --2- 172.21.15.115:0/1107404787 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2284142e50 0x7f22841434f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f22800099b0 tx=0x7f2280009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b777e3cde23d0cee server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:27.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.035+0000 7f227bfff700 1 -- 172.21.15.115:0/1107404787 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228000b820 con 0x7f2284142e50 2023-09-29T23:06:27.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.035+0000 7f227bfff700 1 -- 172.21.15.115:0/1107404787 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228000b980 con 0x7f2284142e50 2023-09-29T23:06:27.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.035+0000 7f227bfff700 1 -- 172.21.15.115:0/1107404787 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228000bd20 con 0x7f2284142e50 2023-09-29T23:06:27.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.035+0000 7f228a1aa700 1 -- 172.21.15.115:0/1107404787 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2284142e50 msgr2=0x7f22841434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:27.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.035+0000 7f228a1aa700 1 --2- 172.21.15.115:0/1107404787 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2284142e50 0x7f22841434f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f22800099b0 tx=0x7f2280009250 comp rx=0 tx=0).stop 2023-09-29T23:06:27.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.035+0000 7f228a1aa700 1 -- 172.21.15.115:0/1107404787 shutdown_connections 2023-09-29T23:06:27.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.035+0000 7f228a1aa700 1 --2- 172.21.15.115:0/1107404787 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2284142e50 0x7f22841434f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:27.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.035+0000 7f228a1aa700 1 -- 172.21.15.115:0/1107404787 >> 172.21.15.115:0/1107404787 conn(0x7f22840b6c10 msgr2=0x7f2284067bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:27.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.035+0000 7f228a1aa700 1 -- 172.21.15.115:0/1107404787 shutdown_connections 2023-09-29T23:06:27.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.035+0000 7f228a1aa700 1 -- 172.21.15.115:0/1107404787 wait complete. 2023-09-29T23:06:27.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f228a1aa700 1 Processor -- start 2023-09-29T23:06:27.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f228a1aa700 1 -- start start 2023-09-29T23:06:27.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f228a1aa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f228409fc60 0x7f22840ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:27.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f228a1aa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2284142e50 0x7f228414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:27.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f228a1aa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2284143a30 0x7f22841503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:27.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f228a1aa700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2284150b20 con 0x7f2284143a30 2023-09-29T23:06:27.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f228a1aa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22840a46d0 con 0x7f2284142e50 2023-09-29T23:06:27.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f228a1aa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22840aa060 con 0x7f228409fc60 2023-09-29T23:06:27.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22891a8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f228409fc60 0x7f22840ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:27.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22891a8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f228409fc60 0x7f22840ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:38386/0 (socket says 172.21.15.115:38386) 2023-09-29T23:06:27.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22891a8700 1 -- 172.21.15.115:0/4016649689 learned_addr learned my addr 172.21.15.115:0/4016649689 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:27.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22899a9700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2284143a30 0x7f22841503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:27.045 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22889a7700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2284142e50 0x7f228414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:27.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22891a8700 1 -- 172.21.15.115:0/4016649689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2284142e50 msgr2=0x7f228414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:27.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22891a8700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2284142e50 0x7f228414fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:27.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22891a8700 1 -- 172.21.15.115:0/4016649689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2284143a30 msgr2=0x7f22841503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:27.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22891a8700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2284143a30 0x7f22841503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:27.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22891a8700 1 -- 172.21.15.115:0/4016649689 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22800094f0 con 0x7f228409fc60 2023-09-29T23:06:27.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22899a9700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2284143a30 0x7f22841503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:06:27.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22891a8700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f228409fc60 0x7f22840ad250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f227400c5d0 tx=0x7f2274007f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:27.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22797fa700 1 -- 172.21.15.115:0/4016649689 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274011590 con 0x7f228409fc60 2023-09-29T23:06:27.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22797fa700 1 -- 172.21.15.115:0/4016649689 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2274011710 con 0x7f228409fc60 2023-09-29T23:06:27.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f228a1aa700 1 -- 172.21.15.115:0/4016649689 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228414f930 con 0x7f228409fc60 2023-09-29T23:06:27.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f22797fa700 1 -- 172.21.15.115:0/4016649689 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274011ad0 con 0x7f228409fc60 2023-09-29T23:06:27.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.039+0000 7f228a1aa700 1 -- 172.21.15.115:0/4016649689 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22840a9d00 con 0x7f228409fc60 2023-09-29T23:06:27.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.043+0000 7f228a1aa700 1 -- 172.21.15.115:0/4016649689 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2284063c30 con 0x7f228409fc60 2023-09-29T23:06:27.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.043+0000 7f22797fa700 1 -- 172.21.15.115:0/4016649689 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f227401c460 con 0x7f228409fc60 2023-09-29T23:06:27.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.043+0000 7f22797fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:27.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.043+0000 7f22797fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:27.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.043+0000 7f22797fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:27.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.043+0000 7f22797fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:27.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.043+0000 7f22797fa700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f226808e8b0 0x7f2268090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:27.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.043+0000 7f22797fa700 1 -- 172.21.15.115:0/4016649689 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f22740b4640 con 0x7f228409fc60 2023-09-29T23:06:27.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.047+0000 7f22889a7700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f226808e8b0 0x7f2268090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:27.050 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.047+0000 7f22889a7700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f226808e8b0 0x7f2268090d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22800099b0 tx=0x7f2280016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:27.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.051+0000 7f22797fa700 1 -- 172.21.15.115:0/4016649689 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2284063c30 con 0x7f228409fc60 2023-09-29T23:06:27.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 1 -- 172.21.15.115:0/4016649689 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2284063c30 con 0x7f228409fc60 2023-09-29T23:06:27.255 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f22797fa700 1 -- 172.21.15.115:0/4016649689 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2284063c30 con 0x7f228409fc60 2023-09-29T23:06:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:27.255 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:27.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 10 mgrc shutdown 2023-09-29T23:06:27.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 1 -- 172.21.15.115:0/4016649689 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f226808e8b0 msgr2=0x7f2268090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:27.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f226808e8b0 0x7f2268090d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22800099b0 tx=0x7f2280016000 comp rx=0 tx=0).stop 2023-09-29T23:06:27.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 1 -- 172.21.15.115:0/4016649689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f228409fc60 msgr2=0x7f22840ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:27.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f228409fc60 0x7f22840ad250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f227400c5d0 tx=0x7f2274007f60 comp rx=0 tx=0).stop 2023-09-29T23:06:27.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 1 -- 172.21.15.115:0/4016649689 shutdown_connections 2023-09-29T23:06:27.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f226808e8b0 0x7f2268090d60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:27.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2284143a30 0x7f22841503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:27.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2284142e50 0x7f228414fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:27.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 1 --2- 172.21.15.115:0/4016649689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f228409fc60 0x7f22840ad250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:27.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 1 -- 172.21.15.115:0/4016649689 >> 172.21.15.115:0/4016649689 conn(0x7f22840b6c10 msgr2=0x7f228413f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:27.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 1 -- 172.21.15.115:0/4016649689 shutdown_connections 2023-09-29T23:06:27.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:27.251+0000 7f228a1aa700 1 -- 172.21.15.115:0/4016649689 wait complete. 2023-09-29T23:06:30.274 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:30.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7dee1700 1 Processor -- start 2023-09-29T23:06:30.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7dee1700 1 -- start start 2023-09-29T23:06:30.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7dee1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1a78067b60 0x7f1a7806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:30.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7dee1700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1a7806ec40 0x7f1a780a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:30.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7dee1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a780a5e40 0x7f1a78147a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:30.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7dee1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a780b01c0 con 0x7f1a78067b60 2023-09-29T23:06:30.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7dee1700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a78067f30 con 0x7f1a7806ec40 2023-09-29T23:06:30.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7dee1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7806f390 con 0x7f1a780a5e40 2023-09-29T23:06:30.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7cedf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1a78067b60 0x7f1a7806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:30.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7d6e0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a780a5e40 0x7f1a78147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:30.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7cedf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1a78067b60 0x7f1a7806db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54146/0 (socket says 172.21.15.115:54146) 2023-09-29T23:06:30.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7d6e0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a780a5e40 0x7f1a78147a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:38388/0 (socket says 172.21.15.115:38388) 2023-09-29T23:06:30.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7cedf700 1 -- 172.21.15.115:0/1037627009 learned_addr learned my addr 172.21.15.115:0/1037627009 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:30.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a77fff700 1 --2- 172.21.15.115:0/1037627009 >> v2:172.21.15.156:3300/0 conn(0x7f1a7806ec40 0x7f1a780a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:30.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7cedf700 1 -- 172.21.15.115:0/1037627009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a780a5e40 msgr2=0x7f1a78147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:30.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7cedf700 1 --2- 172.21.15.115:0/1037627009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a780a5e40 0x7f1a78147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:30.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7cedf700 1 -- 172.21.15.115:0/1037627009 >> v2:172.21.15.156:3300/0 conn(0x7f1a7806ec40 msgr2=0x7f1a780a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:30.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7cedf700 1 --2- 172.21.15.115:0/1037627009 >> v2:172.21.15.156:3300/0 conn(0x7f1a7806ec40 0x7f1a780a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:30.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7cedf700 1 -- 172.21.15.115:0/1037627009 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7806f630 con 0x7f1a78067b60 2023-09-29T23:06:30.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a77fff700 1 --2- 172.21.15.115:0/1037627009 >> v2:172.21.15.156:3300/0 conn(0x7f1a7806ec40 0x7f1a780a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:06:30.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a7cedf700 1 --2- 172.21.15.115:0/1037627009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a78067b60 0x7f1a7806db60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1a780b2e00 tx=0x7f1a60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52bb6009cc89ada server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:30.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a777fe700 1 -- 172.21.15.115:0/1037627009 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6000b640 con 0x7f1a78067b60 2023-09-29T23:06:30.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a777fe700 1 -- 172.21.15.115:0/1037627009 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6000b7a0 con 0x7f1a78067b60 2023-09-29T23:06:30.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.379+0000 7f1a777fe700 1 -- 172.21.15.115:0/1037627009 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6000bb60 con 0x7f1a78067b60 2023-09-29T23:06:30.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 -- 172.21.15.115:0/1037627009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a78067b60 msgr2=0x7f1a7806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:30.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 --2- 172.21.15.115:0/1037627009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a78067b60 0x7f1a7806db60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1a780b2e00 tx=0x7f1a60009250 comp rx=0 tx=0).stop 2023-09-29T23:06:30.389 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 -- 172.21.15.115:0/1037627009 shutdown_connections 2023-09-29T23:06:30.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 --2- 172.21.15.115:0/1037627009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a780a5e40 0x7f1a78147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:30.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 --2- 172.21.15.115:0/1037627009 >> v2:172.21.15.156:3300/0 conn(0x7f1a7806ec40 0x7f1a780a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:30.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 --2- 172.21.15.115:0/1037627009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a78067b60 0x7f1a7806db60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:30.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 -- 172.21.15.115:0/1037627009 >> 172.21.15.115:0/1037627009 conn(0x7f1a78068a40 msgr2=0x7f1a78068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:30.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 -- 172.21.15.115:0/1037627009 shutdown_connections 2023-09-29T23:06:30.390 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 -- 172.21.15.115:0/1037627009 wait complete. 2023-09-29T23:06:30.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 Processor -- start 2023-09-29T23:06:30.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 -- start start 2023-09-29T23:06:30.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a78067b60 0x7f1a78095290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:30.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a7806ec40 0x7f1a78096610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:30.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a780a5e40 0x7f1a78153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:30.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78154db0 con 0x7f1a78067b60 2023-09-29T23:06:30.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78095e30 con 0x7f1a7806ec40 2023-09-29T23:06:30.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7dee1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7809ed30 con 0x7f1a780a5e40 2023-09-29T23:06:30.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.383+0000 7f1a7d6e0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a780a5e40 0x7f1a78153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:30.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a7cedf700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a78067b60 0x7f1a78095290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:30.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a7d6e0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a780a5e40 0x7f1a78153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:38400/0 (socket says 172.21.15.115:38400) 2023-09-29T23:06:30.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a7d6e0700 1 -- 172.21.15.115:0/256911652 learned_addr learned my addr 172.21.15.115:0/256911652 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:30.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a77fff700 1 --2- 172.21.15.115:0/256911652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a7806ec40 0x7f1a78096610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:30.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a7d6e0700 1 -- 172.21.15.115:0/256911652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a7806ec40 msgr2=0x7f1a78096610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:30.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a7d6e0700 1 --2- 172.21.15.115:0/256911652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a7806ec40 0x7f1a78096610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:30.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a7d6e0700 1 -- 172.21.15.115:0/256911652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a78067b60 msgr2=0x7f1a78095290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:30.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a7d6e0700 1 --2- 172.21.15.115:0/256911652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a78067b60 0x7f1a78095290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:30.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a7d6e0700 1 -- 172.21.15.115:0/256911652 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a70009a20 con 0x7f1a780a5e40 2023-09-29T23:06:30.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a7d6e0700 1 --2- 172.21.15.115:0/256911652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a780a5e40 0x7f1a78153160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800e900 tx=0x7f1a680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:30.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a74ff9700 1 -- 172.21.15.115:0/256911652 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68013680 con 0x7f1a780a5e40 2023-09-29T23:06:30.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a74ff9700 1 -- 172.21.15.115:0/256911652 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a680137e0 con 0x7f1a780a5e40 2023-09-29T23:06:30.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a7dee1700 1 -- 172.21.15.115:0/256911652 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a600094f0 con 0x7f1a780a5e40 2023-09-29T23:06:30.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a74ff9700 1 -- 172.21.15.115:0/256911652 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68013ba0 con 0x7f1a780a5e40 2023-09-29T23:06:30.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a7dee1700 1 -- 172.21.15.115:0/256911652 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a780957d0 con 0x7f1a780a5e40 2023-09-29T23:06:30.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a7dee1700 1 -- 172.21.15.115:0/256911652 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7804be00 con 0x7f1a780a5e40 2023-09-29T23:06:30.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a74ff9700 1 -- 172.21.15.115:0/256911652 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f1a680123d0 con 0x7f1a780a5e40 2023-09-29T23:06:30.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.387+0000 7f1a74ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:30.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.391+0000 7f1a74ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:30.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.391+0000 7f1a74ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:30.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.391+0000 7f1a74ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:30.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.391+0000 7f1a74ff9700 1 --2- 172.21.15.115:0/256911652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1a5808e8e0 0x7f1a58090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:30.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.391+0000 7f1a74ff9700 1 -- 172.21.15.115:0/256911652 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f1a680b4860 con 0x7f1a780a5e40 2023-09-29T23:06:30.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.391+0000 7f1a7cedf700 1 --2- 172.21.15.115:0/256911652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1a5808e8e0 0x7f1a58090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:30.398 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.391+0000 7f1a7cedf700 1 --2- 172.21.15.115:0/256911652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1a5808e8e0 0x7f1a58090d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a780b2e00 tx=0x7f1a60017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:30.401 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.395+0000 7f1a74ff9700 1 -- 172.21.15.115:0/256911652 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1a68085290 con 0x7f1a780a5e40 2023-09-29T23:06:30.595 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.591+0000 7f1a7dee1700 1 -- 172.21.15.115:0/256911652 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1a780a5900 con 0x7f1a780a5e40 2023-09-29T23:06:30.596 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.591+0000 7f1a74ff9700 1 -- 172.21.15.115:0/256911652 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f1a680888b0 con 0x7f1a780a5e40 2023-09-29T23:06:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:30.596 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:30.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.595+0000 7f1a7dee1700 10 mgrc shutdown 2023-09-29T23:06:30.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.595+0000 7f1a7dee1700 1 -- 172.21.15.115:0/256911652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1a5808e8e0 msgr2=0x7f1a58090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:30.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.595+0000 7f1a7dee1700 1 --2- 172.21.15.115:0/256911652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1a5808e8e0 0x7f1a58090d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a780b2e00 tx=0x7f1a60017000 comp rx=0 tx=0).stop 2023-09-29T23:06:30.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.595+0000 7f1a7dee1700 1 -- 172.21.15.115:0/256911652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a780a5e40 msgr2=0x7f1a78153160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:30.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.595+0000 7f1a7dee1700 1 --2- 172.21.15.115:0/256911652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a780a5e40 0x7f1a78153160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800e900 tx=0x7f1a680091a0 comp rx=0 tx=0).stop 2023-09-29T23:06:30.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.595+0000 7f1a7dee1700 1 -- 172.21.15.115:0/256911652 shutdown_connections 2023-09-29T23:06:30.599 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.595+0000 7f1a7dee1700 1 --2- 172.21.15.115:0/256911652 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a780a5e40 0x7f1a78153160 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:30.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.595+0000 7f1a7dee1700 1 --2- 172.21.15.115:0/256911652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a7806ec40 0x7f1a78096610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:30.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.595+0000 7f1a7dee1700 1 --2- 172.21.15.115:0/256911652 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f1a5808e8e0 0x7f1a58090d90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:30.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.595+0000 7f1a7dee1700 1 --2- 172.21.15.115:0/256911652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a78067b60 0x7f1a78095290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:30.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.595+0000 7f1a7dee1700 1 -- 172.21.15.115:0/256911652 >> 172.21.15.115:0/256911652 conn(0x7f1a78068a40 msgr2=0x7f1a780b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:30.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.595+0000 7f1a7dee1700 1 -- 172.21.15.115:0/256911652 shutdown_connections 2023-09-29T23:06:30.600 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:30.595+0000 7f1a7dee1700 1 -- 172.21.15.115:0/256911652 wait complete. 2023-09-29T23:06:33.611 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:33.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e2ca3b700 1 Processor -- start 2023-09-29T23:06:33.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e2ca3b700 1 -- start start 2023-09-29T23:06:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e2ca3b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e28148170 0x7f3e2806ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e2ca3b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e28067f30 con 0x7f3e28067b60 2023-09-29T23:06:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e2ca3b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2806f390 con 0x7f3e2806db60 2023-09-29T23:06:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e2ca3b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280b01c0 con 0x7f3e28148170 2023-09-29T23:06:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e277fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3e28067b60 0x7f3e280a5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:50472/0 (socket says 172.21.15.115:50472) 2023-09-29T23:06:33.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e277fe700 1 -- 172.21.15.115:0/3528095853 learned_addr learned my addr 172.21.15.115:0/3528095853 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:06:33.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e27fff700 1 --2- 172.21.15.115:0/3528095853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e28148170 0x7f3e2806ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:33.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e267fc700 1 -- 172.21.15.115:0/3528095853 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084042387 0 0) 0x7f3e28067f30 con 0x7f3e28067b60 2023-09-29T23:06:33.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e267fc700 1 -- 172.21.15.115:0/3528095853 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e10003570 con 0x7f3e28067b60 2023-09-29T23:06:33.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e27fff700 1 -- 172.21.15.115:0/3528095853 >> v1:172.21.15.156:6789/0 conn(0x7f3e2806db60 legacy=0x7f3e28147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:33.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e27fff700 1 -- 172.21.15.115:0/3528095853 >> v1:172.21.15.115:6789/0 conn(0x7f3e28067b60 legacy=0x7f3e280a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:33.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e27fff700 1 -- 172.21.15.115:0/3528095853 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2806f630 con 0x7f3e28148170 2023-09-29T23:06:33.725 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e27fff700 1 --2- 172.21.15.115:0/3528095853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e28148170 0x7f3e2806ec40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009910 tx=0x7f3e200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47b888a329443848 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:33.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e267fc700 1 -- 172.21.15.115:0/3528095853 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2000b680 con 0x7f3e28148170 2023-09-29T23:06:33.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e267fc700 1 -- 172.21.15.115:0/3528095853 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2000b7e0 con 0x7f3e28148170 2023-09-29T23:06:33.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.719+0000 7f3e267fc700 1 -- 172.21.15.115:0/3528095853 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2000bb60 con 0x7f3e28148170 2023-09-29T23:06:33.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/3528095853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e28148170 msgr2=0x7f3e2806ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:33.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 --2- 172.21.15.115:0/3528095853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e28148170 0x7f3e2806ec40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009910 tx=0x7f3e200091a0 comp rx=0 tx=0).stop 2023-09-29T23:06:33.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/3528095853 shutdown_connections 2023-09-29T23:06:33.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 --2- 172.21.15.115:0/3528095853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e28148170 0x7f3e2806ec40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:33.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/3528095853 >> 172.21.15.115:0/3528095853 conn(0x7f3e28068a40 msgr2=0x7f3e28068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:33.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/3528095853 shutdown_connections 2023-09-29T23:06:33.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/3528095853 wait complete. 2023-09-29T23:06:33.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 Processor -- start 2023-09-29T23:06:33.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 -- start start 2023-09-29T23:06:33.730 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e28067b60 0x7f3e28094ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:33.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e2806db60 0x7f3e281540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:33.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e28148170 0x7f3e2809e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:33.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2809f830 con 0x7f3e28148170 2023-09-29T23:06:33.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280a1080 con 0x7f3e28067b60 2023-09-29T23:06:33.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.723+0000 7f3e2ca3b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280a1340 con 0x7f3e2806db60 2023-09-29T23:06:33.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e27fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e28148170 0x7f3e2809e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:33.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e26ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e2806db60 0x7f3e281540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:33.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e27fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e28148170 0x7f3e2809e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54170/0 (socket says 172.21.15.115:54170) 2023-09-29T23:06:33.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e27fff700 1 -- 172.21.15.115:0/349075785 learned_addr learned my addr 172.21.15.115:0/349075785 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:33.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e277fe700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e28067b60 0x7f3e28094ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:33.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e27fff700 1 -- 172.21.15.115:0/349075785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e2806db60 msgr2=0x7f3e281540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:33.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e27fff700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e2806db60 0x7f3e281540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:33.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e27fff700 1 -- 172.21.15.115:0/349075785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e28067b60 msgr2=0x7f3e28094ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:33.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e27fff700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e28067b60 0x7f3e28094ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:33.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e27fff700 1 -- 172.21.15.115:0/349075785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e20009420 con 0x7f3e28148170 2023-09-29T23:06:33.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e26ffd700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e2806db60 0x7f3e281540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:06:33.732 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e27fff700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e28148170 0x7f3e2809e450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3e200091e0 tx=0x7f3e20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:33.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e0f7fe700 1 -- 172.21.15.115:0/349075785 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2000bb60 con 0x7f3e28148170 2023-09-29T23:06:33.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e0f7fe700 1 -- 172.21.15.115:0/349075785 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2001a430 con 0x7f3e28148170 2023-09-29T23:06:33.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/349075785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e280a1600 con 0x7f3e28148170 2023-09-29T23:06:33.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e0f7fe700 1 -- 172.21.15.115:0/349075785 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2001a7f0 con 0x7f3e28148170 2023-09-29T23:06:33.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/349075785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2809c770 con 0x7f3e28148170 2023-09-29T23:06:33.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.727+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/349075785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2804be00 con 0x7f3e28148170 2023-09-29T23:06:33.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.731+0000 7f3e0f7fe700 1 -- 172.21.15.115:0/349075785 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f3e2001abe0 con 0x7f3e28148170 2023-09-29T23:06:33.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.731+0000 7f3e0f7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:33.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.731+0000 7f3e0f7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:33.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.731+0000 7f3e0f7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:33.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.731+0000 7f3e0f7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:33.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.731+0000 7f3e0f7fe700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3e1408e8b0 0x7f3e14090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:33.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.731+0000 7f3e0f7fe700 1 -- 172.21.15.115:0/349075785 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f3e200b6e10 con 0x7f3e28148170 2023-09-29T23:06:33.736 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.731+0000 7f3e277fe700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3e1408e8b0 0x7f3e14090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:33.737 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.731+0000 7f3e277fe700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3e1408e8b0 0x7f3e14090d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c007fd0 tx=0x7f3e1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:33.740 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.735+0000 7f3e0f7fe700 1 -- 172.21.15.115:0/349075785 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3e200877a0 con 0x7f3e28148170 2023-09-29T23:06:33.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.927+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/349075785 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3e2809bd20 con 0x7f3e28148170 2023-09-29T23:06:33.934 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e0f7fe700 1 -- 172.21.15.115:0/349075785 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f3e20015100 con 0x7f3e28148170 2023-09-29T23:06:33.934 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:33.934 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:33.936 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e2ca3b700 10 mgrc shutdown 2023-09-29T23:06:33.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/349075785 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3e1408e8b0 msgr2=0x7f3e14090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:33.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e2ca3b700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3e1408e8b0 0x7f3e14090d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c007fd0 tx=0x7f3e1c009040 comp rx=0 tx=0).stop 2023-09-29T23:06:33.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/349075785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e28148170 msgr2=0x7f3e2809e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:33.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e2ca3b700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e28148170 0x7f3e2809e450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3e200091e0 tx=0x7f3e20017000 comp rx=0 tx=0).stop 2023-09-29T23:06:33.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/349075785 shutdown_connections 2023-09-29T23:06:33.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e2ca3b700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3e1408e8b0 0x7f3e14090d60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:33.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e2ca3b700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e28148170 0x7f3e2809e450 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:33.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e2ca3b700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e2806db60 0x7f3e281540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:33.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e2ca3b700 1 --2- 172.21.15.115:0/349075785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e28067b60 0x7f3e28094ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:33.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/349075785 >> 172.21.15.115:0/349075785 conn(0x7f3e28068a40 msgr2=0x7f3e28146c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:33.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/349075785 shutdown_connections 2023-09-29T23:06:33.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:33.931+0000 7f3e2ca3b700 1 -- 172.21.15.115:0/349075785 wait complete. 2023-09-29T23:06:36.949 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:37.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 Processor -- start 2023-09-29T23:06:37.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 -- start start 2023-09-29T23:06:37.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbfa80a5d60 0x7fbfa80a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:37.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa813fbd0 0x7fbfa8146f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:37.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa80a5900 con 0x7fbfa809c190 2023-09-29T23:06:37.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa809c560 con 0x7fbfa80a5d60 2023-09-29T23:06:37.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa8140180 con 0x7fbfa813fbd0 2023-09-29T23:06:37.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaddf4700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbfa809c190 0x7fbfa806a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56542/0 (socket says 172.21.15.115:56542) 2023-09-29T23:06:37.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfad5f3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbfa80a5d60 0x7fbfa80a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:37.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaddf4700 1 -- 172.21.15.115:0/1849431775 learned_addr learned my addr 172.21.15.115:0/1849431775 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:06:37.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfae5f5700 1 --2- 172.21.15.115:0/1849431775 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa813fbd0 0x7fbfa8146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:37.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfacdf2700 1 -- 172.21.15.115:0/1849431775 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791976740 0 0) 0x7fbfa4001110 con 0x7fbfa809c190 2023-09-29T23:06:37.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfacdf2700 1 -- 172.21.15.115:0/1849431775 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf94003570 con 0x7fbfa809c190 2023-09-29T23:06:37.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfae5f5700 1 -- 172.21.15.115:0/1849431775 >> v2:172.21.15.115:3300/0 conn(0x7fbfa80a5d60 msgr2=0x7fbfa80a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:37.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfae5f5700 1 --2- 172.21.15.115:0/1849431775 >> v2:172.21.15.115:3300/0 conn(0x7fbfa80a5d60 0x7fbfa80a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:37.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfae5f5700 1 -- 172.21.15.115:0/1849431775 >> v1:172.21.15.115:6789/0 conn(0x7fbfa809c190 legacy=0x7fbfa806a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:37.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfacdf2700 1 -- 172.21.15.115:0/1849431775 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1212996889 0 0) 0x7fbf94003570 con 0x7fbfa809c190 2023-09-29T23:06:37.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfae5f5700 1 -- 172.21.15.115:0/1849431775 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa8140420 con 0x7fbfa813fbd0 2023-09-29T23:06:37.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfad5f3700 1 --2- 172.21.15.115:0/1849431775 >> v2:172.21.15.115:3300/0 conn(0x7fbfa80a5d60 0x7fbfa80a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:06:37.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfae5f5700 1 --2- 172.21.15.115:0/1849431775 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa813fbd0 0x7fbfa8146f70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000d0d0 tx=0x7fbfa000b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c10c78312f41015 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:37.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfacdf2700 1 -- 172.21.15.115:0/1849431775 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0010070 con 0x7fbfa813fbd0 2023-09-29T23:06:37.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfacdf2700 1 -- 172.21.15.115:0/1849431775 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa000b0d0 con 0x7fbfa813fbd0 2023-09-29T23:06:37.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfacdf2700 1 -- 172.21.15.115:0/1849431775 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4001600 con 0x7fbfa813fbd0 2023-09-29T23:06:37.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 -- 172.21.15.115:0/1849431775 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa813fbd0 msgr2=0x7fbfa8146f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:37.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 --2- 172.21.15.115:0/1849431775 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa813fbd0 0x7fbfa8146f70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000d0d0 tx=0x7fbfa000b990 comp rx=0 tx=0).stop 2023-09-29T23:06:37.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 -- 172.21.15.115:0/1849431775 shutdown_connections 2023-09-29T23:06:37.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 --2- 172.21.15.115:0/1849431775 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa813fbd0 0x7fbfa8146f70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:37.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 --2- 172.21.15.115:0/1849431775 >> v2:172.21.15.115:3300/0 conn(0x7fbfa80a5d60 0x7fbfa80a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:37.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 -- 172.21.15.115:0/1849431775 >> 172.21.15.115:0/1849431775 conn(0x7fbfa8068a40 msgr2=0x7fbfa8068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:37.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 -- 172.21.15.115:0/1849431775 shutdown_connections 2023-09-29T23:06:37.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.063+0000 7fbfaedf6700 1 -- 172.21.15.115:0/1849431775 wait complete. 2023-09-29T23:06:37.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.067+0000 7fbfaedf6700 1 Processor -- start 2023-09-29T23:06:37.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.067+0000 7fbfaedf6700 1 -- start start 2023-09-29T23:06:37.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.067+0000 7fbfaedf6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfa809c190 0x7fbfa80b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:37.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.067+0000 7fbfaedf6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa80a5d60 0x7fbfa8139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:37.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.067+0000 7fbfaedf6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa813fbd0 0x7fbfa814b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:37.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.067+0000 7fbfaedf6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa80a0e00 con 0x7fbfa80a5d60 2023-09-29T23:06:37.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.067+0000 7fbfaedf6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa80a28d0 con 0x7fbfa809c190 2023-09-29T23:06:37.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.067+0000 7fbfaedf6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa814c590 con 0x7fbfa813fbd0 2023-09-29T23:06:37.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.067+0000 7fbfad5f3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa80a5d60 0x7fbfa8139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.067+0000 7fbfad5f3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa80a5d60 0x7fbfa8139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37256/0 (socket says 172.21.15.115:37256) 2023-09-29T23:06:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.067+0000 7fbfad5f3700 1 -- 172.21.15.115:0/4112320930 learned_addr learned my addr 172.21.15.115:0/4112320930 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.067+0000 7fbfae5f5700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa813fbd0 0x7fbfa814b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.071+0000 7fbfaddf4700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfa809c190 0x7fbfa80b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.071+0000 7fbfad5f3700 1 -- 172.21.15.115:0/4112320930 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa813fbd0 msgr2=0x7fbfa814b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.071+0000 7fbfad5f3700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa813fbd0 0x7fbfa814b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.071+0000 7fbfad5f3700 1 -- 172.21.15.115:0/4112320930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfa809c190 msgr2=0x7fbfa80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.071+0000 7fbfad5f3700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfa809c190 0x7fbfa80b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.071+0000 7fbfad5f3700 1 -- 172.21.15.115:0/4112320930 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf98009420 con 0x7fbfa80a5d60 2023-09-29T23:06:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.071+0000 7fbfad5f3700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa80a5d60 0x7fbfa8139fb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800ec80 tx=0x7fbf980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:37.076 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.071+0000 7fbf9dffb700 1 -- 172.21.15.115:0/4112320930 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9800c8e0 con 0x7fbfa80a5d60 2023-09-29T23:06:37.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.071+0000 7fbf9dffb700 1 -- 172.21.15.115:0/4112320930 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9800ca40 con 0x7fbfa80a5d60 2023-09-29T23:06:37.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.071+0000 7fbfaedf6700 1 -- 172.21.15.115:0/4112320930 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa000bc30 con 0x7fbfa80a5d60 2023-09-29T23:06:37.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.071+0000 7fbf9dffb700 1 -- 172.21.15.115:0/4112320930 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9800cdc0 con 0x7fbfa80a5d60 2023-09-29T23:06:37.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.071+0000 7fbfaedf6700 1 -- 172.21.15.115:0/4112320930 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa814be40 con 0x7fbfa80a5d60 2023-09-29T23:06:37.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.071+0000 7fbfaedf6700 1 -- 172.21.15.115:0/4112320930 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa804be00 con 0x7fbfa80a5d60 2023-09-29T23:06:37.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.075+0000 7fbf9dffb700 1 -- 172.21.15.115:0/4112320930 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fbf98013680 con 0x7fbfa80a5d60 2023-09-29T23:06:37.078 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.075+0000 7fbf9dffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.075+0000 7fbf9dffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.075+0000 7fbf9dffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.075+0000 7fbf9dffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.075+0000 7fbf9dffb700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbf8c08e8b0 0x7fbf8c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.075+0000 7fbf9dffb700 1 -- 172.21.15.115:0/4112320930 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fbf980b4ce0 con 0x7fbfa80a5d60 2023-09-29T23:06:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.075+0000 7fbfaddf4700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbf8c08e8b0 0x7fbf8c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.075+0000 7fbfaddf4700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbf8c08e8b0 0x7fbf8c090d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4004e10 tx=0x7fbfa4001310 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:37.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.079+0000 7fbf9dffb700 1 -- 172.21.15.115:0/4112320930 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbf980855e0 con 0x7fbfa80a5d60 2023-09-29T23:06:37.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.279+0000 7fbfaedf6700 1 -- 172.21.15.115:0/4112320930 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbfa806fa40 con 0x7fbfa80a5d60 2023-09-29T23:06:37.283 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.279+0000 7fbf9dffb700 1 -- 172.21.15.115:0/4112320930 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fbf98021100 con 0x7fbfa80a5d60 2023-09-29T23:06:37.283 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:37.284 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:37.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.279+0000 7fbfaedf6700 10 mgrc shutdown 2023-09-29T23:06:37.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.279+0000 7fbfaedf6700 1 -- 172.21.15.115:0/4112320930 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbf8c08e8b0 msgr2=0x7fbf8c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:37.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.279+0000 7fbfaedf6700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbf8c08e8b0 0x7fbf8c090d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4004e10 tx=0x7fbfa4001310 comp rx=0 tx=0).stop 2023-09-29T23:06:37.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.279+0000 7fbfaedf6700 1 -- 172.21.15.115:0/4112320930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa80a5d60 msgr2=0x7fbfa8139fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:37.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.279+0000 7fbfaedf6700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa80a5d60 0x7fbfa8139fb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800ec80 tx=0x7fbf980091a0 comp rx=0 tx=0).stop 2023-09-29T23:06:37.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.279+0000 7fbfaedf6700 1 -- 172.21.15.115:0/4112320930 shutdown_connections 2023-09-29T23:06:37.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.279+0000 7fbfaedf6700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbfa813fbd0 0x7fbfa814b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:37.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.279+0000 7fbfaedf6700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbf8c08e8b0 0x7fbf8c090d60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:37.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.279+0000 7fbfaedf6700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbfa80a5d60 0x7fbfa8139fb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:37.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.279+0000 7fbfaedf6700 1 --2- 172.21.15.115:0/4112320930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfa809c190 0x7fbfa80b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:37.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.279+0000 7fbfaedf6700 1 -- 172.21.15.115:0/4112320930 >> 172.21.15.115:0/4112320930 conn(0x7fbfa8068a40 msgr2=0x7fbfa806de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:37.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.283+0000 7fbfaedf6700 1 -- 172.21.15.115:0/4112320930 shutdown_connections 2023-09-29T23:06:37.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:37.283+0000 7fbfaedf6700 1 -- 172.21.15.115:0/4112320930 wait complete. 2023-09-29T23:06:38.850 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:06:38.853 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:06:40.299 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:40.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.407+0000 7f26eaf32700 1 Processor -- start 2023-09-29T23:06:40.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.407+0000 7f26eaf32700 1 -- start start 2023-09-29T23:06:40.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.407+0000 7f26eaf32700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26e40a4140 0x7f26e40670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.407+0000 7f26eaf32700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f26e4068130 0x7f26e409da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.407+0000 7f26eaf32700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e40675e0 con 0x7f26e409d680 2023-09-29T23:06:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.407+0000 7f26eaf32700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e409df90 con 0x7f26e4068130 2023-09-29T23:06:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.407+0000 7f26eaf32700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e40a3710 con 0x7f26e40a4140 2023-09-29T23:06:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.407+0000 7f26ea731700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f26e4068130 0x7f26e409da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.407+0000 7f26ea731700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f26e4068130 0x7f26e409da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37258/0 (socket says 172.21.15.115:37258) 2023-09-29T23:06:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.407+0000 7f26ea731700 1 -- 172.21.15.115:0/920107381 learned_addr learned my addr 172.21.15.115:0/920107381 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:40.414 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.407+0000 7f26e9f30700 1 --2- 172.21.15.115:0/920107381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26e40a4140 0x7f26e40670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:40.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26e9f30700 1 -- 172.21.15.115:0/920107381 >> v2:172.21.15.115:3300/0 conn(0x7f26e4068130 msgr2=0x7f26e409da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:40.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26e9f30700 1 --2- 172.21.15.115:0/920107381 >> v2:172.21.15.115:3300/0 conn(0x7f26e4068130 0x7f26e409da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:40.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26e9f30700 1 -- 172.21.15.115:0/920107381 >> v1:172.21.15.156:6789/0 conn(0x7f26e409d680 legacy=0x7f26e4067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:40.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26e8f2e700 1 -- 172.21.15.115:0/920107381 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295450059 0 0) 0x7f26e0001110 con 0x7f26e409d680 2023-09-29T23:06:40.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26e9f30700 1 -- 172.21.15.115:0/920107381 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e409bd40 con 0x7f26e40a4140 2023-09-29T23:06:40.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26ea731700 1 --2- 172.21.15.115:0/920107381 >> v2:172.21.15.115:3300/0 conn(0x7f26e4068130 0x7f26e409da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:06:40.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26e9f30700 1 --2- 172.21.15.115:0/920107381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26e40a4140 0x7f26e40670a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f26d80098e0 tx=0x7f26d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b708f9348020af9d server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:40.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26e8f2e700 1 -- 172.21.15.115:0/920107381 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800b6d0 con 0x7f26e40a4140 2023-09-29T23:06:40.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26e8f2e700 1 -- 172.21.15.115:0/920107381 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800b830 con 0x7f26e40a4140 2023-09-29T23:06:40.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26e8f2e700 1 -- 172.21.15.115:0/920107381 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800bbd0 con 0x7f26e40a4140 2023-09-29T23:06:40.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26eaf32700 1 -- 172.21.15.115:0/920107381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26e40a4140 msgr2=0x7f26e40670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:40.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26eaf32700 1 --2- 172.21.15.115:0/920107381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26e40a4140 0x7f26e40670a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f26d80098e0 tx=0x7f26d80091a0 comp rx=0 tx=0).stop 2023-09-29T23:06:40.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26eaf32700 1 -- 172.21.15.115:0/920107381 shutdown_connections 2023-09-29T23:06:40.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26eaf32700 1 --2- 172.21.15.115:0/920107381 >> v2:172.21.15.115:3300/0 conn(0x7f26e4068130 0x7f26e409da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:40.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26eaf32700 1 --2- 172.21.15.115:0/920107381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26e40a4140 0x7f26e40670a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:40.417 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26eaf32700 1 -- 172.21.15.115:0/920107381 >> 172.21.15.115:0/920107381 conn(0x7f26e40b1d20 msgr2=0x7f26e40b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:40.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26eaf32700 1 -- 172.21.15.115:0/920107381 shutdown_connections 2023-09-29T23:06:40.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.411+0000 7f26eaf32700 1 -- 172.21.15.115:0/920107381 wait complete. 2023-09-29T23:06:40.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26eaf32700 1 Processor -- start 2023-09-29T23:06:40.418 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26eaf32700 1 -- start start 2023-09-29T23:06:40.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26eaf32700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e4068130 0x7f26e40a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:40.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26eaf32700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26e409d680 0x7f26e40969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:40.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26eaf32700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26e40a4140 0x7f26e4156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:40.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26eaf32700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e406d6e0 con 0x7f26e40a4140 2023-09-29T23:06:40.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26eaf32700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e40961f0 con 0x7f26e4068130 2023-09-29T23:06:40.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26eaf32700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e4097260 con 0x7f26e409d680 2023-09-29T23:06:40.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26e972f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26e409d680 0x7f26e40969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:40.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26ea731700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26e40a4140 0x7f26e4156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:40.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26e972f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26e409d680 0x7f26e40969d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:36824/0 (socket says 172.21.15.115:36824) 2023-09-29T23:06:40.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26e972f700 1 -- 172.21.15.115:0/3357209621 learned_addr learned my addr 172.21.15.115:0/3357209621 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:40.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26ea731700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26e40a4140 0x7f26e4156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37264/0 (socket says 172.21.15.115:37264) 2023-09-29T23:06:40.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26e9f30700 1 --2- 172.21.15.115:0/3357209621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e4068130 0x7f26e40a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:40.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26e972f700 1 -- 172.21.15.115:0/3357209621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e4068130 msgr2=0x7f26e40a0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:40.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26e972f700 1 --2- 172.21.15.115:0/3357209621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e4068130 0x7f26e40a0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:40.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26e972f700 1 -- 172.21.15.115:0/3357209621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26e40a4140 msgr2=0x7f26e4156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:40.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26e972f700 1 --2- 172.21.15.115:0/3357209621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26e40a4140 0x7f26e4156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:40.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26e972f700 1 -- 172.21.15.115:0/3357209621 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc009ae0 con 0x7f26e409d680 2023-09-29T23:06:40.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26e972f700 1 --2- 172.21.15.115:0/3357209621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26e409d680 0x7f26e40969d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f26e000c7e0 tx=0x7f26e0007c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:40.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26d5ffb700 1 -- 172.21.15.115:0/3357209621 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e0011590 con 0x7f26e409d680 2023-09-29T23:06:40.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26d5ffb700 1 -- 172.21.15.115:0/3357209621 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e0011710 con 0x7f26e409d680 2023-09-29T23:06:40.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26eaf32700 1 -- 172.21.15.115:0/3357209621 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d8009420 con 0x7f26e409d680 2023-09-29T23:06:40.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26d5ffb700 1 -- 172.21.15.115:0/3357209621 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e0011ad0 con 0x7f26e409d680 2023-09-29T23:06:40.423 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.415+0000 7f26eaf32700 1 -- 172.21.15.115:0/3357209621 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e4096f10 con 0x7f26e409d680 2023-09-29T23:06:40.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.419+0000 7f26eaf32700 1 -- 172.21.15.115:0/3357209621 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e4096670 con 0x7f26e409d680 2023-09-29T23:06:40.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.419+0000 7f26d5ffb700 1 -- 172.21.15.115:0/3357209621 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f26e0012420 con 0x7f26e409d680 2023-09-29T23:06:40.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.419+0000 7f26d5ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:40.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.419+0000 7f26d5ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:40.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.419+0000 7f26d5ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:40.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.419+0000 7f26d5ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:40.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.419+0000 7f26d5ffb700 1 --2- 172.21.15.115:0/3357209621 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f26c808e8b0 0x7f26c8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:40.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.419+0000 7f26d5ffb700 1 -- 172.21.15.115:0/3357209621 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f26e00b3980 con 0x7f26e409d680 2023-09-29T23:06:40.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.423+0000 7f26e9f30700 1 --2- 172.21.15.115:0/3357209621 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f26c808e8b0 0x7f26c8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:40.426 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.423+0000 7f26e9f30700 1 --2- 172.21.15.115:0/3357209621 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f26c808e8b0 0x7f26c8090d60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f26d80093f0 tx=0x7f26d8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:40.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.431+0000 7f26d5ffb700 1 -- 172.21.15.115:0/3357209621 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f26e0049be0 con 0x7f26e409d680 2023-09-29T23:06:40.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.631+0000 7f26eaf32700 1 -- 172.21.15.115:0/3357209621 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f26e40675e0 con 0x7f26e409d680 2023-09-29T23:06:40.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.631+0000 7f26d5ffb700 1 -- 172.21.15.115:0/3357209621 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f26e0017100 con 0x7f26e409d680 2023-09-29T23:06:40.636 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:40.636 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:40.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.631+0000 7f26eaf32700 10 mgrc shutdown 2023-09-29T23:06:40.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.635+0000 7f26eaf32700 1 -- 172.21.15.115:0/3357209621 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f26c808e8b0 msgr2=0x7f26c8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:40.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.635+0000 7f26eaf32700 1 --2- 172.21.15.115:0/3357209621 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f26c808e8b0 0x7f26c8090d60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f26d80093f0 tx=0x7f26d8017000 comp rx=0 tx=0).stop 2023-09-29T23:06:40.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.635+0000 7f26eaf32700 1 -- 172.21.15.115:0/3357209621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26e409d680 msgr2=0x7f26e40969d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:40.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.635+0000 7f26eaf32700 1 --2- 172.21.15.115:0/3357209621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26e409d680 0x7f26e40969d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f26e000c7e0 tx=0x7f26e0007c60 comp rx=0 tx=0).stop 2023-09-29T23:06:40.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.635+0000 7f26eaf32700 1 -- 172.21.15.115:0/3357209621 shutdown_connections 2023-09-29T23:06:40.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.635+0000 7f26eaf32700 1 --2- 172.21.15.115:0/3357209621 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f26c808e8b0 0x7f26c8090d60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:40.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.635+0000 7f26eaf32700 1 --2- 172.21.15.115:0/3357209621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26e40a4140 0x7f26e4156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:40.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.635+0000 7f26eaf32700 1 --2- 172.21.15.115:0/3357209621 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26e409d680 0x7f26e40969d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:40.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.635+0000 7f26eaf32700 1 --2- 172.21.15.115:0/3357209621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e4068130 0x7f26e40a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:40.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.635+0000 7f26eaf32700 1 -- 172.21.15.115:0/3357209621 >> 172.21.15.115:0/3357209621 conn(0x7f26e40b1d20 msgr2=0x7f26e4069510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:40.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.635+0000 7f26eaf32700 1 -- 172.21.15.115:0/3357209621 shutdown_connections 2023-09-29T23:06:40.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:40.635+0000 7f26eaf32700 1 -- 172.21.15.115:0/3357209621 wait complete. 2023-09-29T23:06:43.651 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:43.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b2d518700 1 Processor -- start 2023-09-29T23:06:43.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b2d518700 1 -- start start 2023-09-29T23:06:43.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b2d518700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5b2809d9e0 0x7f5b28140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:43.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b2d518700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5b2809ddb0 0x7f5b2809f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:43.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b2d518700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2813e770 con 0x7f5b2813d700 2023-09-29T23:06:43.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b2d518700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b28141d20 con 0x7f5b2809ddb0 2023-09-29T23:06:43.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b2d518700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2813dc00 con 0x7f5b2809d9e0 2023-09-29T23:06:43.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b277fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5b2809ddb0 0x7f5b2809f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:43.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b277fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5b2809ddb0 0x7f5b2809f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37268/0 (socket says 172.21.15.115:37268) 2023-09-29T23:06:43.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b2cd17700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5b2813d700 0x7f5b28141610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56552/0 (socket says 172.21.15.115:56552) 2023-09-29T23:06:43.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b277fe700 1 -- 172.21.15.115:0/2571396903 learned_addr learned my addr 172.21.15.115:0/2571396903 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:43.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b27fff700 1 --2- 172.21.15.115:0/2571396903 >> v2:172.21.15.156:3300/0 conn(0x7f5b2809d9e0 0x7f5b28140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:43.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b277fe700 1 -- 172.21.15.115:0/2571396903 >> v2:172.21.15.156:3300/0 conn(0x7f5b2809d9e0 msgr2=0x7f5b28140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:43.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b277fe700 1 --2- 172.21.15.115:0/2571396903 >> v2:172.21.15.156:3300/0 conn(0x7f5b2809d9e0 0x7f5b28140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:43.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b277fe700 1 -- 172.21.15.115:0/2571396903 >> v1:172.21.15.115:6789/0 conn(0x7f5b2813d700 legacy=0x7f5b28141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:43.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b277fe700 1 -- 172.21.15.115:0/2571396903 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2813dec0 con 0x7f5b2809ddb0 2023-09-29T23:06:43.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b27fff700 1 --2- 172.21.15.115:0/2571396903 >> v2:172.21.15.156:3300/0 conn(0x7f5b2809d9e0 0x7f5b28140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:06:43.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b277fe700 1 --2- 172.21.15.115:0/2571396903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2809ddb0 0x7f5b2809f640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5b2806b300 tx=0x7f5b18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4867fff8286e84 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:43.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b26ffd700 1 -- 172.21.15.115:0/2571396903 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1800b8f0 con 0x7f5b2809ddb0 2023-09-29T23:06:43.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b26ffd700 1 -- 172.21.15.115:0/2571396903 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1800ba50 con 0x7f5b2809ddb0 2023-09-29T23:06:43.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.759+0000 7f5b26ffd700 1 -- 172.21.15.115:0/2571396903 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1800bdf0 con 0x7f5b2809ddb0 2023-09-29T23:06:43.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 -- 172.21.15.115:0/2571396903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2809ddb0 msgr2=0x7f5b2809f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:43.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 --2- 172.21.15.115:0/2571396903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2809ddb0 0x7f5b2809f640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5b2806b300 tx=0x7f5b18009250 comp rx=0 tx=0).stop 2023-09-29T23:06:43.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 -- 172.21.15.115:0/2571396903 shutdown_connections 2023-09-29T23:06:43.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 --2- 172.21.15.115:0/2571396903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2809ddb0 0x7f5b2809f640 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:43.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 --2- 172.21.15.115:0/2571396903 >> v2:172.21.15.156:3300/0 conn(0x7f5b2809d9e0 0x7f5b28140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:43.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 -- 172.21.15.115:0/2571396903 >> 172.21.15.115:0/2571396903 conn(0x7f5b280b1d20 msgr2=0x7f5b280b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:43.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 -- 172.21.15.115:0/2571396903 shutdown_connections 2023-09-29T23:06:43.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 -- 172.21.15.115:0/2571396903 wait complete. 2023-09-29T23:06:43.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 Processor -- start 2023-09-29T23:06:43.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 -- start start 2023-09-29T23:06:43.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b2809d9e0 0x7f5b280b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:43.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2809ddb0 0x7f5b2809c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:43.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b2813d700 0x7f5b2809d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:43.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2809a920 con 0x7f5b2809ddb0 2023-09-29T23:06:43.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2809d840 con 0x7f5b2809d9e0 2023-09-29T23:06:43.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2d518700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2809a660 con 0x7f5b2813d700 2023-09-29T23:06:43.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b277fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2809ddb0 0x7f5b2809c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:43.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b2cd17700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b2813d700 0x7f5b2809d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:43.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b277fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2809ddb0 0x7f5b2809c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37280/0 (socket says 172.21.15.115:37280) 2023-09-29T23:06:43.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b277fe700 1 -- 172.21.15.115:0/2921016523 learned_addr learned my addr 172.21.15.115:0/2921016523 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:43.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.763+0000 7f5b27fff700 1 --2- 172.21.15.115:0/2921016523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b2809d9e0 0x7f5b280b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:43.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.767+0000 7f5b2cd17700 1 -- 172.21.15.115:0/2921016523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b2809d9e0 msgr2=0x7f5b280b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:43.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.767+0000 7f5b2cd17700 1 --2- 172.21.15.115:0/2921016523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b2809d9e0 0x7f5b280b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:43.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.767+0000 7f5b2cd17700 1 -- 172.21.15.115:0/2921016523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2809ddb0 msgr2=0x7f5b2809c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:43.771 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.767+0000 7f5b2cd17700 1 --2- 172.21.15.115:0/2921016523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2809ddb0 0x7f5b2809c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:43.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.767+0000 7f5b2cd17700 1 -- 172.21.15.115:0/2921016523 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b180094f0 con 0x7f5b2813d700 2023-09-29T23:06:43.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.767+0000 7f5b2cd17700 1 --2- 172.21.15.115:0/2921016523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b2813d700 0x7f5b2809d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000cbd0 tx=0x7f5b200019b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:43.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.767+0000 7f5b0ffff700 1 -- 172.21.15.115:0/2921016523 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20005df0 con 0x7f5b2813d700 2023-09-29T23:06:43.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.767+0000 7f5b0ffff700 1 -- 172.21.15.115:0/2921016523 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2000a660 con 0x7f5b2813d700 2023-09-29T23:06:43.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.767+0000 7f5b2d518700 1 -- 172.21.15.115:0/2921016523 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b28098fc0 con 0x7f5b2813d700 2023-09-29T23:06:43.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.767+0000 7f5b0ffff700 1 -- 172.21.15.115:0/2921016523 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2000a9e0 con 0x7f5b2813d700 2023-09-29T23:06:43.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.767+0000 7f5b2d518700 1 -- 172.21.15.115:0/2921016523 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2809a130 con 0x7f5b2813d700 2023-09-29T23:06:43.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.767+0000 7f5b2d518700 1 -- 172.21.15.115:0/2921016523 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2804be00 con 0x7f5b2813d700 2023-09-29T23:06:43.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.771+0000 7f5b0ffff700 1 -- 172.21.15.115:0/2921016523 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f5b200070f0 con 0x7f5b2813d700 2023-09-29T23:06:43.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.771+0000 7f5b0ffff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:43.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.771+0000 7f5b0ffff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:43.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.771+0000 7f5b0ffff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:43.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.771+0000 7f5b0ffff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:43.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.771+0000 7f5b0ffff700 1 --2- 172.21.15.115:0/2921016523 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5b1408e8b0 0x7f5b14090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:43.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.771+0000 7f5b0ffff700 1 -- 172.21.15.115:0/2921016523 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f5b200b52c0 con 0x7f5b2813d700 2023-09-29T23:06:43.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.771+0000 7f5b27fff700 1 --2- 172.21.15.115:0/2921016523 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5b1408e8b0 0x7f5b14090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:43.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.771+0000 7f5b27fff700 1 --2- 172.21.15.115:0/2921016523 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5b1408e8b0 0x7f5b14090d60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c006f00 tx=0x7f5b1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:43.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.775+0000 7f5b0ffff700 1 -- 172.21.15.115:0/2921016523 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5b20085bc0 con 0x7f5b2813d700 2023-09-29T23:06:43.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.975+0000 7f5b2d518700 1 -- 172.21.15.115:0/2921016523 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5b280a3700 con 0x7f5b2813d700 2023-09-29T23:06:43.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.975+0000 7f5b0ffff700 1 -- 172.21.15.115:0/2921016523 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f5b200891e0 con 0x7f5b2813d700 2023-09-29T23:06:43.981 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:43.981 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.979+0000 7f5b2d518700 10 mgrc shutdown 2023-09-29T23:06:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.979+0000 7f5b2d518700 1 -- 172.21.15.115:0/2921016523 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5b1408e8b0 msgr2=0x7f5b14090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.979+0000 7f5b2d518700 1 --2- 172.21.15.115:0/2921016523 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5b1408e8b0 0x7f5b14090d60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c006f00 tx=0x7f5b1c008040 comp rx=0 tx=0).stop 2023-09-29T23:06:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.979+0000 7f5b2d518700 1 -- 172.21.15.115:0/2921016523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b2813d700 msgr2=0x7f5b2809d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.979+0000 7f5b2d518700 1 --2- 172.21.15.115:0/2921016523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b2813d700 0x7f5b2809d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000cbd0 tx=0x7f5b200019b0 comp rx=0 tx=0).stop 2023-09-29T23:06:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.979+0000 7f5b2d518700 1 -- 172.21.15.115:0/2921016523 shutdown_connections 2023-09-29T23:06:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.979+0000 7f5b2d518700 1 --2- 172.21.15.115:0/2921016523 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b2813d700 0x7f5b2809d300 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.979+0000 7f5b2d518700 1 --2- 172.21.15.115:0/2921016523 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5b1408e8b0 0x7f5b14090d60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.979+0000 7f5b2d518700 1 --2- 172.21.15.115:0/2921016523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2809ddb0 0x7f5b2809c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.979+0000 7f5b2d518700 1 --2- 172.21.15.115:0/2921016523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b2809d9e0 0x7f5b280b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.979+0000 7f5b2d518700 1 -- 172.21.15.115:0/2921016523 >> 172.21.15.115:0/2921016523 conn(0x7f5b280b1d20 msgr2=0x7f5b280b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.979+0000 7f5b2d518700 1 -- 172.21.15.115:0/2921016523 shutdown_connections 2023-09-29T23:06:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:43.979+0000 7f5b2d518700 1 -- 172.21.15.115:0/2921016523 wait complete. 2023-09-29T23:06:46.995 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:47.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.103+0000 7fe639643700 1 Processor -- start 2023-09-29T23:06:47.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.103+0000 7fe639643700 1 -- start start 2023-09-29T23:06:47.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe639643700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe63406e9a0 0x7fe634068f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:47.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe639643700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6340697f0 con 0x7fe6340a4860 2023-09-29T23:06:47.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe639643700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6340694c0 con 0x7fe63406ed70 2023-09-29T23:06:47.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe639643700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe634068560 con 0x7fe63406e9a0 2023-09-29T23:06:47.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe633fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe63406e9a0 0x7fe634068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:47.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe6337fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe6340a4860 0x7fe6341434d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42772/0 (socket says 172.21.15.115:42772) 2023-09-29T23:06:47.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe6337fe700 1 -- 172.21.15.115:0/1836401405 learned_addr learned my addr 172.21.15.115:0/1836401405 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:06:47.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe633fff700 1 -- 172.21.15.115:0/1836401405 >> v1:172.21.15.156:6789/0 conn(0x7fe63406ed70 legacy=0x7fe63414a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:47.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe633fff700 1 -- 172.21.15.115:0/1836401405 >> v1:172.21.15.115:6789/0 conn(0x7fe6340a4860 legacy=0x7fe6341434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:47.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe632ffd700 1 -- 172.21.15.115:0/1836401405 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020041795 0 0) 0x7fe6340697f0 con 0x7fe6340a4860 2023-09-29T23:06:47.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe633fff700 1 -- 172.21.15.115:0/1836401405 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6340686a0 con 0x7fe63406e9a0 2023-09-29T23:06:47.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe633fff700 1 --2- 172.21.15.115:0/1836401405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe63406e9a0 0x7fe634068f80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe624009e60 tx=0x7fe624009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9c4d832adb3023 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:47.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe632ffd700 1 -- 172.21.15.115:0/1836401405 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62400e070 con 0x7fe63406e9a0 2023-09-29T23:06:47.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe632ffd700 1 -- 172.21.15.115:0/1836401405 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62400bc30 con 0x7fe63406e9a0 2023-09-29T23:06:47.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe632ffd700 1 -- 172.21.15.115:0/1836401405 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624012430 con 0x7fe63406e9a0 2023-09-29T23:06:47.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe639643700 1 -- 172.21.15.115:0/1836401405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe63406e9a0 msgr2=0x7fe634068f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:47.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe639643700 1 --2- 172.21.15.115:0/1836401405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe63406e9a0 0x7fe634068f80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe624009e60 tx=0x7fe624009780 comp rx=0 tx=0).stop 2023-09-29T23:06:47.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe639643700 1 -- 172.21.15.115:0/1836401405 shutdown_connections 2023-09-29T23:06:47.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe639643700 1 --2- 172.21.15.115:0/1836401405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe63406e9a0 0x7fe634068f80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:47.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe639643700 1 -- 172.21.15.115:0/1836401405 >> 172.21.15.115:0/1836401405 conn(0x7fe6340a3470 msgr2=0x7fe6340a3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:47.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe639643700 1 -- 172.21.15.115:0/1836401405 shutdown_connections 2023-09-29T23:06:47.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.107+0000 7fe639643700 1 -- 172.21.15.115:0/1836401405 wait complete. 2023-09-29T23:06:47.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe639643700 1 Processor -- start 2023-09-29T23:06:47.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe639643700 1 -- start start 2023-09-29T23:06:47.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe639643700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe63406e9a0 0x7fe63411cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:47.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe639643700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe63406ed70 0x7fe6340b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:47.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe639643700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6340a4860 0x7fe6340af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:47.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe639643700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63411d1d0 con 0x7fe63406ed70 2023-09-29T23:06:47.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe639643700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340ae590 con 0x7fe6340a4860 2023-09-29T23:06:47.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe639643700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340afe00 con 0x7fe63406e9a0 2023-09-29T23:06:47.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe633fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe63406e9a0 0x7fe63411cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:47.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe6337fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe63406ed70 0x7fe6340b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:47.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe633fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe63406e9a0 0x7fe63411cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:60148/0 (socket says 172.21.15.115:60148) 2023-09-29T23:06:47.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe633fff700 1 -- 172.21.15.115:0/2228273577 learned_addr learned my addr 172.21.15.115:0/2228273577 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:47.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe638e42700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6340a4860 0x7fe6340af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:47.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe633fff700 1 -- 172.21.15.115:0/2228273577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6340a4860 msgr2=0x7fe6340af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:47.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe633fff700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6340a4860 0x7fe6340af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:47.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe633fff700 1 -- 172.21.15.115:0/2228273577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe63406ed70 msgr2=0x7fe6340b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:47.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe633fff700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe63406ed70 0x7fe6340b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:47.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe633fff700 1 -- 172.21.15.115:0/2228273577 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe624009a20 con 0x7fe63406e9a0 2023-09-29T23:06:47.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe638e42700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6340a4860 0x7fe6340af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:06:47.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe6337fe700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe63406ed70 0x7fe6340b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:06:47.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe633fff700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe63406e9a0 0x7fe63411cc90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe6240099f0 tx=0x7fe624019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:47.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe61bfff700 1 -- 172.21.15.115:0/2228273577 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624012ea0 con 0x7fe63406e9a0 2023-09-29T23:06:47.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe61bfff700 1 -- 172.21.15.115:0/2228273577 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe624027470 con 0x7fe63406e9a0 2023-09-29T23:06:47.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe639643700 1 -- 172.21.15.115:0/2228273577 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6340b00c0 con 0x7fe63406e9a0 2023-09-29T23:06:47.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe61bfff700 1 -- 172.21.15.115:0/2228273577 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624027830 con 0x7fe63406e9a0 2023-09-29T23:06:47.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.111+0000 7fe639643700 1 -- 172.21.15.115:0/2228273577 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63413f260 con 0x7fe63406e9a0 2023-09-29T23:06:47.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.115+0000 7fe639643700 1 -- 172.21.15.115:0/2228273577 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63413f450 con 0x7fe63406e9a0 2023-09-29T23:06:47.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.115+0000 7fe61bfff700 1 -- 172.21.15.115:0/2228273577 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fe624024070 con 0x7fe63406e9a0 2023-09-29T23:06:47.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.115+0000 7fe61bfff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:47.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.115+0000 7fe61bfff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:47.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.115+0000 7fe61bfff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:47.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.115+0000 7fe61bfff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:47.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.115+0000 7fe61bfff700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe62008e8b0 0x7fe620090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:47.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.115+0000 7fe61bfff700 1 -- 172.21.15.115:0/2228273577 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fe6240b7030 con 0x7fe63406e9a0 2023-09-29T23:06:47.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.119+0000 7fe6337fe700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe62008e8b0 0x7fe620090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:47.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.119+0000 7fe6337fe700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe62008e8b0 0x7fe620090d60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe63406c2d0 tx=0x7fe628007f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:47.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.123+0000 7fe61bfff700 1 -- 172.21.15.115:0/2228273577 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe63413f450 con 0x7fe63406e9a0 2023-09-29T23:06:47.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 1 -- 172.21.15.115:0/2228273577 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe6340af170 con 0x7fe63406e9a0 2023-09-29T23:06:47.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe61bfff700 1 -- 172.21.15.115:0/2228273577 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fe6340af170 con 0x7fe63406e9a0 2023-09-29T23:06:47.319 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:47.319 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:47.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 10 mgrc shutdown 2023-09-29T23:06:47.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 1 -- 172.21.15.115:0/2228273577 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe62008e8b0 msgr2=0x7fe620090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:47.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe62008e8b0 0x7fe620090d60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe63406c2d0 tx=0x7fe628007f50 comp rx=0 tx=0).stop 2023-09-29T23:06:47.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 1 -- 172.21.15.115:0/2228273577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe63406e9a0 msgr2=0x7fe63411cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:47.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe63406e9a0 0x7fe63411cc90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe6240099f0 tx=0x7fe624019000 comp rx=0 tx=0).stop 2023-09-29T23:06:47.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 1 -- 172.21.15.115:0/2228273577 shutdown_connections 2023-09-29T23:06:47.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6340a4860 0x7fe6340af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:47.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe62008e8b0 0x7fe620090d60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:47.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe63406ed70 0x7fe6340b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:47.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 1 --2- 172.21.15.115:0/2228273577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe63406e9a0 0x7fe63411cc90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:47.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 1 -- 172.21.15.115:0/2228273577 >> 172.21.15.115:0/2228273577 conn(0x7fe6340a3470 msgr2=0x7fe6340a3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:47.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 1 -- 172.21.15.115:0/2228273577 shutdown_connections 2023-09-29T23:06:47.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:47.315+0000 7fe639643700 1 -- 172.21.15.115:0/2228273577 wait complete. 2023-09-29T23:06:50.333 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:50.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.439+0000 7fd8c666a700 1 Processor -- start 2023-09-29T23:06:50.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.439+0000 7fd8c666a700 1 -- start start 2023-09-29T23:06:50.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.439+0000 7fd8c666a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd8c0067b60 0x7fd8c009d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:50.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.439+0000 7fd8c666a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8c013fb10 0x7fd8c013ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:50.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.439+0000 7fd8c666a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c009ce00 con 0x7fd8c00a4120 2023-09-29T23:06:50.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.439+0000 7fd8c666a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c009c630 con 0x7fd8c0067b60 2023-09-29T23:06:50.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.439+0000 7fd8c666a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0067f30 con 0x7fd8c013fb10 2023-09-29T23:06:50.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.439+0000 7fd8c5e69700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8c013fb10 0x7fd8c013ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:50.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.439+0000 7fd8c5668700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd8c0067b60 0x7fd8c009d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:50.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.439+0000 7fd8c4e67700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd8c00a4120 0x7fd8c009bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42786/0 (socket says 172.21.15.115:42786) 2023-09-29T23:06:50.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.439+0000 7fd8c4e67700 1 -- 172.21.15.115:0/2973494223 learned_addr learned my addr 172.21.15.115:0/2973494223 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:06:50.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.439+0000 7fd8b7fff700 1 -- 172.21.15.115:0/2973494223 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158171210 0 0) 0x7fd8c009ce00 con 0x7fd8c00a4120 2023-09-29T23:06:50.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8c5e69700 1 -- 172.21.15.115:0/2973494223 >> v2:172.21.15.115:3300/0 conn(0x7fd8c0067b60 msgr2=0x7fd8c009d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:50.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8c5e69700 1 --2- 172.21.15.115:0/2973494223 >> v2:172.21.15.115:3300/0 conn(0x7fd8c0067b60 0x7fd8c009d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:50.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8c5e69700 1 -- 172.21.15.115:0/2973494223 >> v1:172.21.15.115:6789/0 conn(0x7fd8c00a4120 legacy=0x7fd8c009bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:50.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8c5e69700 1 -- 172.21.15.115:0/2973494223 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c009d970 con 0x7fd8c013fb10 2023-09-29T23:06:50.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8c5e69700 1 --2- 172.21.15.115:0/2973494223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8c013fb10 0x7fd8c013ff50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009e60 tx=0x7fd8b8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb6d5a1d82bce8a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:50.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8b7fff700 1 -- 172.21.15.115:0/2973494223 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b800e070 con 0x7fd8c013fb10 2023-09-29T23:06:50.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8b7fff700 1 -- 172.21.15.115:0/2973494223 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b800bb60 con 0x7fd8c013fb10 2023-09-29T23:06:50.448 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8b7fff700 1 -- 172.21.15.115:0/2973494223 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8012430 con 0x7fd8c013fb10 2023-09-29T23:06:50.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8c666a700 1 -- 172.21.15.115:0/2973494223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8c013fb10 msgr2=0x7fd8c013ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:50.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8c666a700 1 --2- 172.21.15.115:0/2973494223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8c013fb10 0x7fd8c013ff50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009e60 tx=0x7fd8b8009780 comp rx=0 tx=0).stop 2023-09-29T23:06:50.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8c666a700 1 -- 172.21.15.115:0/2973494223 shutdown_connections 2023-09-29T23:06:50.449 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8c666a700 1 --2- 172.21.15.115:0/2973494223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8c013fb10 0x7fd8c013ff50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:50.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8c666a700 1 --2- 172.21.15.115:0/2973494223 >> v2:172.21.15.115:3300/0 conn(0x7fd8c0067b60 0x7fd8c009d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:50.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8c666a700 1 -- 172.21.15.115:0/2973494223 >> 172.21.15.115:0/2973494223 conn(0x7fd8c00b1d20 msgr2=0x7fd8c00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:50.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8c666a700 1 -- 172.21.15.115:0/2973494223 shutdown_connections 2023-09-29T23:06:50.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.443+0000 7fd8c666a700 1 -- 172.21.15.115:0/2973494223 wait complete. 2023-09-29T23:06:50.450 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c666a700 1 Processor -- start 2023-09-29T23:06:50.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c666a700 1 -- start start 2023-09-29T23:06:50.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c666a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8c0067b60 0x7fd8c0140a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:50.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c666a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8c00a4120 0x7fd8c01420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:50.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c666a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8c013fb10 0x7fd8c01425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:50.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c666a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0141a10 con 0x7fd8c00a4120 2023-09-29T23:06:50.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c666a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c014cdf0 con 0x7fd8c013fb10 2023-09-29T23:06:50.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c666a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c014d050 con 0x7fd8c0067b60 2023-09-29T23:06:50.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c5668700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8c0067b60 0x7fd8c0140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:50.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c5668700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8c0067b60 0x7fd8c0140a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:60160/0 (socket says 172.21.15.115:60160) 2023-09-29T23:06:50.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c5668700 1 -- 172.21.15.115:0/1785326396 learned_addr learned my addr 172.21.15.115:0/1785326396 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:50.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c4e67700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8c00a4120 0x7fd8c01420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:50.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c5e69700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8c013fb10 0x7fd8c01425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:50.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c5668700 1 -- 172.21.15.115:0/1785326396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8c013fb10 msgr2=0x7fd8c01425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:50.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c5668700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8c013fb10 0x7fd8c01425e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:50.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c5668700 1 -- 172.21.15.115:0/1785326396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8c00a4120 msgr2=0x7fd8c01420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:50.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c5668700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8c00a4120 0x7fd8c01420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:50.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c5668700 1 -- 172.21.15.115:0/1785326396 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b8009a20 con 0x7fd8c0067b60 2023-09-29T23:06:50.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c5e69700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8c013fb10 0x7fd8c01425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:06:50.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c5668700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8c0067b60 0x7fd8c0140a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000ec80 tx=0x7fd8b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:50.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8b57fa700 1 -- 172.21.15.115:0/1785326396 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000c8e0 con 0x7fd8c0067b60 2023-09-29T23:06:50.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8b57fa700 1 -- 172.21.15.115:0/1785326396 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b000ca40 con 0x7fd8c0067b60 2023-09-29T23:06:50.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c666a700 1 -- 172.21.15.115:0/1785326396 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c0140fd0 con 0x7fd8c0067b60 2023-09-29T23:06:50.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8b57fa700 1 -- 172.21.15.115:0/1785326396 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000cde0 con 0x7fd8c0067b60 2023-09-29T23:06:50.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.447+0000 7fd8c666a700 1 -- 172.21.15.115:0/1785326396 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c00995c0 con 0x7fd8c0067b60 2023-09-29T23:06:50.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.451+0000 7fd8c666a700 1 -- 172.21.15.115:0/1785326396 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c004be00 con 0x7fd8c0067b60 2023-09-29T23:06:50.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.451+0000 7fd8b57fa700 1 -- 172.21.15.115:0/1785326396 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fd8b0013680 con 0x7fd8c0067b60 2023-09-29T23:06:50.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.451+0000 7fd8b57fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:50.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.455+0000 7fd8b57fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:50.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.455+0000 7fd8b57fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:50.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.455+0000 7fd8b57fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:50.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.455+0000 7fd8b57fa700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd8a408e8e0 0x7fd8a4090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:50.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.455+0000 7fd8b57fa700 1 -- 172.21.15.115:0/1785326396 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fd8b00b5390 con 0x7fd8c0067b60 2023-09-29T23:06:50.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.455+0000 7fd8c4e67700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd8a408e8e0 0x7fd8a4090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:50.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.455+0000 7fd8c4e67700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd8a408e8e0 0x7fd8a4090d90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8c009f390 tx=0x7fd8bc007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:50.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.459+0000 7fd8b57fa700 1 -- 172.21.15.115:0/1785326396 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd8b0085d30 con 0x7fd8c0067b60 2023-09-29T23:06:50.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.655+0000 7fd8c666a700 1 -- 172.21.15.115:0/1785326396 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd8c009dc10 con 0x7fd8c0067b60 2023-09-29T23:06:50.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.655+0000 7fd8b57fa700 1 -- 172.21.15.115:0/1785326396 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fd8b0021100 con 0x7fd8c0067b60 2023-09-29T23:06:50.659 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:50.660 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:50.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.655+0000 7fd8c666a700 10 mgrc shutdown 2023-09-29T23:06:50.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.655+0000 7fd8c666a700 1 -- 172.21.15.115:0/1785326396 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd8a408e8e0 msgr2=0x7fd8a4090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:50.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.655+0000 7fd8c666a700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd8a408e8e0 0x7fd8a4090d90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8c009f390 tx=0x7fd8bc007d50 comp rx=0 tx=0).stop 2023-09-29T23:06:50.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.659+0000 7fd8c666a700 1 -- 172.21.15.115:0/1785326396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8c0067b60 msgr2=0x7fd8c0140a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:50.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.659+0000 7fd8c666a700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8c0067b60 0x7fd8c0140a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000ec80 tx=0x7fd8b00091a0 comp rx=0 tx=0).stop 2023-09-29T23:06:50.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.659+0000 7fd8c666a700 1 -- 172.21.15.115:0/1785326396 shutdown_connections 2023-09-29T23:06:50.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.659+0000 7fd8c666a700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8c013fb10 0x7fd8c01425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:50.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.659+0000 7fd8c666a700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd8a408e8e0 0x7fd8a4090d90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:50.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.659+0000 7fd8c666a700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8c00a4120 0x7fd8c01420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:50.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.659+0000 7fd8c666a700 1 --2- 172.21.15.115:0/1785326396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8c0067b60 0x7fd8c0140a90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:50.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.659+0000 7fd8c666a700 1 -- 172.21.15.115:0/1785326396 >> 172.21.15.115:0/1785326396 conn(0x7fd8c00b1d20 msgr2=0x7fd8c00b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:50.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.659+0000 7fd8c666a700 1 -- 172.21.15.115:0/1785326396 shutdown_connections 2023-09-29T23:06:50.663 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:50.659+0000 7fd8c666a700 1 -- 172.21.15.115:0/1785326396 wait complete. 2023-09-29T23:06:53.675 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:53.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4bc255700 1 Processor -- start 2023-09-29T23:06:53.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4bc255700 1 -- start start 2023-09-29T23:06:53.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4bc255700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b406f420 0x7fd4b4143780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:53.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4bc255700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd4b4143cc0 0x7fd4b414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:53.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4bc255700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b4068f40 con 0x7fd4b4068b70 2023-09-29T23:06:53.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4bc255700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b4144140 con 0x7fd4b4143cc0 2023-09-29T23:06:53.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4bc255700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b406d6f0 con 0x7fd4b406f420 2023-09-29T23:06:53.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4b97f0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b406f420 0x7fd4b4143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:53.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4b97f0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b406f420 0x7fd4b4143780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:60172/0 (socket says 172.21.15.115:60172) 2023-09-29T23:06:53.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4b97f0700 1 -- 172.21.15.115:0/71856887 learned_addr learned my addr 172.21.15.115:0/71856887 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:53.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4ba7f2700 1 --2- 172.21.15.115:0/71856887 >> v2:172.21.15.156:3300/0 conn(0x7fd4b4143cc0 0x7fd4b414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:53.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4b97f0700 1 -- 172.21.15.115:0/71856887 >> v2:172.21.15.156:3300/0 conn(0x7fd4b4143cc0 msgr2=0x7fd4b414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:53.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4b97f0700 1 --2- 172.21.15.115:0/71856887 >> v2:172.21.15.156:3300/0 conn(0x7fd4b4143cc0 0x7fd4b414a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:53.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4b97f0700 1 -- 172.21.15.115:0/71856887 >> v1:172.21.15.156:6789/0 conn(0x7fd4b4068b70 legacy=0x7fd4b406ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:53.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4b97f0700 1 -- 172.21.15.115:0/71856887 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b406f950 con 0x7fd4b406f420 2023-09-29T23:06:53.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.779+0000 7fd4b97f0700 1 --2- 172.21.15.115:0/71856887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b406f420 0x7fd4b4143780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00099b0 tx=0x7fd4b0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4fa67de538eac1 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:53.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.783+0000 7fd4b8fef700 1 -- 172.21.15.115:0/71856887 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0009ea0 con 0x7fd4b406f420 2023-09-29T23:06:53.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.783+0000 7fd4b8fef700 1 -- 172.21.15.115:0/71856887 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b000b860 con 0x7fd4b406f420 2023-09-29T23:06:53.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.783+0000 7fd4b8fef700 1 -- 172.21.15.115:0/71856887 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b000bc00 con 0x7fd4b406f420 2023-09-29T23:06:53.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.783+0000 7fd4bc255700 1 -- 172.21.15.115:0/71856887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b406f420 msgr2=0x7fd4b4143780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:53.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.783+0000 7fd4bc255700 1 --2- 172.21.15.115:0/71856887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b406f420 0x7fd4b4143780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00099b0 tx=0x7fd4b0009250 comp rx=0 tx=0).stop 2023-09-29T23:06:53.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.783+0000 7fd4bc255700 1 -- 172.21.15.115:0/71856887 shutdown_connections 2023-09-29T23:06:53.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.783+0000 7fd4bc255700 1 --2- 172.21.15.115:0/71856887 >> v2:172.21.15.156:3300/0 conn(0x7fd4b4143cc0 0x7fd4b414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:53.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.783+0000 7fd4bc255700 1 --2- 172.21.15.115:0/71856887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b406f420 0x7fd4b4143780 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:53.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.783+0000 7fd4bc255700 1 -- 172.21.15.115:0/71856887 >> 172.21.15.115:0/71856887 conn(0x7fd4b406a870 msgr2=0x7fd4b40b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:53.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.783+0000 7fd4bc255700 1 -- 172.21.15.115:0/71856887 shutdown_connections 2023-09-29T23:06:53.788 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.783+0000 7fd4bc255700 1 -- 172.21.15.115:0/71856887 wait complete. 2023-09-29T23:06:53.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.783+0000 7fd4bc255700 1 Processor -- start 2023-09-29T23:06:53.790 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4bc255700 1 -- start start 2023-09-29T23:06:53.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4bc255700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b4068b70 0x7fd4b40a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:53.792 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4bc255700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b406f420 0x7fd4b40aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:53.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4bc255700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4b4143cc0 0x7fd4b4152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:53.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4bc255700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b4145f70 con 0x7fd4b406f420 2023-09-29T23:06:53.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4bc255700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40ae5f0 con 0x7fd4b4143cc0 2023-09-29T23:06:53.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4bc255700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b4144480 con 0x7fd4b4068b70 2023-09-29T23:06:53.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4b9ff1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b4068b70 0x7fd4b40a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:53.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4b9ff1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b4068b70 0x7fd4b40a1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:60178/0 (socket says 172.21.15.115:60178) 2023-09-29T23:06:53.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4b9ff1700 1 -- 172.21.15.115:0/128210545 learned_addr learned my addr 172.21.15.115:0/128210545 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:53.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4b97f0700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b406f420 0x7fd4b40aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:53.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4ba7f2700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4b4143cc0 0x7fd4b4152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:53.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4b9ff1700 1 -- 172.21.15.115:0/128210545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4b4143cc0 msgr2=0x7fd4b4152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:53.793 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4b9ff1700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4b4143cc0 0x7fd4b4152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:53.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4b9ff1700 1 -- 172.21.15.115:0/128210545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b406f420 msgr2=0x7fd4b40aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:53.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4b9ff1700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b406f420 0x7fd4b40aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:53.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4b9ff1700 1 -- 172.21.15.115:0/128210545 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b00094f0 con 0x7fd4b4068b70 2023-09-29T23:06:53.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4b9ff1700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b4068b70 0x7fd4b40a1bc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400c790 tx=0x7fd4a4007f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:53.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4a9ffb700 1 -- 172.21.15.115:0/128210545 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4011590 con 0x7fd4b4068b70 2023-09-29T23:06:53.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4a9ffb700 1 -- 172.21.15.115:0/128210545 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a4011710 con 0x7fd4b4068b70 2023-09-29T23:06:53.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4bc255700 1 -- 172.21.15.115:0/128210545 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b40ab550 con 0x7fd4b4068b70 2023-09-29T23:06:53.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4a9ffb700 1 -- 172.21.15.115:0/128210545 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4011ad0 con 0x7fd4b4068b70 2023-09-29T23:06:53.794 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.787+0000 7fd4bc255700 1 -- 172.21.15.115:0/128210545 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b41534e0 con 0x7fd4b4068b70 2023-09-29T23:06:53.795 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.791+0000 7fd4bc255700 1 -- 172.21.15.115:0/128210545 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b4070990 con 0x7fd4b4068b70 2023-09-29T23:06:53.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.791+0000 7fd4a9ffb700 1 -- 172.21.15.115:0/128210545 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fd4a401b3b0 con 0x7fd4b4068b70 2023-09-29T23:06:53.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.791+0000 7fd4a9ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:53.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.791+0000 7fd4a9ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:53.796 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.791+0000 7fd4a9ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:53.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.791+0000 7fd4a9ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:53.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.791+0000 7fd4a9ffb700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd49808e8b0 0x7fd498090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:53.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.791+0000 7fd4a9ffb700 1 -- 172.21.15.115:0/128210545 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fd4a40b4010 con 0x7fd4b4068b70 2023-09-29T23:06:53.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.791+0000 7fd4b97f0700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd49808e8b0 0x7fd498090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:53.797 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.795+0000 7fd4b97f0700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd49808e8b0 0x7fd498090d60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00099b0 tx=0x7fd4b0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:53.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.795+0000 7fd4a9ffb700 1 -- 172.21.15.115:0/128210545 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd4a4084a40 con 0x7fd4b4068b70 2023-09-29T23:06:53.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.991+0000 7fd4bc255700 1 -- 172.21.15.115:0/128210545 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd4b4141170 con 0x7fd4b4068b70 2023-09-29T23:06:53.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.991+0000 7fd4a9ffb700 1 -- 172.21.15.115:0/128210545 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fd4a4017020 con 0x7fd4b4068b70 2023-09-29T23:06:53.996 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:53.996 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.995+0000 7fd4bc255700 10 mgrc shutdown 2023-09-29T23:06:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.995+0000 7fd4bc255700 1 -- 172.21.15.115:0/128210545 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd49808e8b0 msgr2=0x7fd498090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.995+0000 7fd4bc255700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd49808e8b0 0x7fd498090d60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00099b0 tx=0x7fd4b0017000 comp rx=0 tx=0).stop 2023-09-29T23:06:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.995+0000 7fd4bc255700 1 -- 172.21.15.115:0/128210545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b4068b70 msgr2=0x7fd4b40a1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.995+0000 7fd4bc255700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b4068b70 0x7fd4b40a1bc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400c790 tx=0x7fd4a4007f40 comp rx=0 tx=0).stop 2023-09-29T23:06:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.995+0000 7fd4bc255700 1 -- 172.21.15.115:0/128210545 shutdown_connections 2023-09-29T23:06:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.995+0000 7fd4bc255700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4b4143cc0 0x7fd4b4152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.995+0000 7fd4bc255700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd49808e8b0 0x7fd498090d60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.995+0000 7fd4bc255700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b406f420 0x7fd4b40aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.995+0000 7fd4bc255700 1 --2- 172.21.15.115:0/128210545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b4068b70 0x7fd4b40a1bc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.995+0000 7fd4bc255700 1 -- 172.21.15.115:0/128210545 >> 172.21.15.115:0/128210545 conn(0x7fd4b406a870 msgr2=0x7fd4b4067870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:53.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.995+0000 7fd4bc255700 1 -- 172.21.15.115:0/128210545 shutdown_connections 2023-09-29T23:06:54.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:53.995+0000 7fd4bc255700 1 -- 172.21.15.115:0/128210545 wait complete. 2023-09-29T23:06:57.011 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:06:57.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14d0984700 1 Processor -- start 2023-09-29T23:06:57.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14d0984700 1 -- start start 2023-09-29T23:06:57.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14d0984700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc0a4140 0x7f14cc0670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:57.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14d0984700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f14cc09d680 0x7f14cc09da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:57.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14d0984700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f14cc067a20 0x7f14cc067e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:57.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14d0984700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14cc09df90 con 0x7f14cc09d680 2023-09-29T23:06:57.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14d0984700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14cc0675e0 con 0x7f14cc067a20 2023-09-29T23:06:57.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14d0984700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc0a3710 con 0x7f14cc0a4140 2023-09-29T23:06:57.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14cb7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc0a4140 0x7f14cc0670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:57.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14c3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f14cc09d680 0x7f14cc09da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:57.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14cb7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc0a4140 0x7f14cc0670a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42800/0 (socket says 172.21.15.115:42800) 2023-09-29T23:06:57.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14cb7fe700 1 -- 172.21.15.115:0/3249335414 learned_addr learned my addr 172.21.15.115:0/3249335414 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:57.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14cbfff700 1 --2- 172.21.15.115:0/3249335414 >> v2:172.21.15.156:3300/0 conn(0x7f14cc067a20 0x7f14cc067e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:57.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14cb7fe700 1 -- 172.21.15.115:0/3249335414 >> v2:172.21.15.156:3300/0 conn(0x7f14cc067a20 msgr2=0x7f14cc067e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:57.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14cb7fe700 1 --2- 172.21.15.115:0/3249335414 >> v2:172.21.15.156:3300/0 conn(0x7f14cc067a20 0x7f14cc067e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:57.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14cb7fe700 1 -- 172.21.15.115:0/3249335414 >> v2:172.21.15.115:3300/0 conn(0x7f14cc09d680 msgr2=0x7f14cc09da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:06:57.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14cb7fe700 1 --2- 172.21.15.115:0/3249335414 >> v2:172.21.15.115:3300/0 conn(0x7f14cc09d680 0x7f14cc09da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:57.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14cb7fe700 1 -- 172.21.15.115:0/3249335414 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc09bd40 con 0x7f14cc0a4140 2023-09-29T23:06:57.127 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14c3fff700 1 --2- 172.21.15.115:0/3249335414 >> v2:172.21.15.115:3300/0 conn(0x7f14cc09d680 0x7f14cc09da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:06:57.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.119+0000 7f14cb7fe700 1 --2- 172.21.15.115:0/3249335414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc0a4140 0x7f14cc0670a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f14cc06a380 tx=0x7f14bc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acd00bccea300eb6 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:57.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14caffd700 1 -- 172.21.15.115:0/3249335414 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc00b6d0 con 0x7f14cc0a4140 2023-09-29T23:06:57.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14caffd700 1 -- 172.21.15.115:0/3249335414 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc00b830 con 0x7f14cc0a4140 2023-09-29T23:06:57.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14caffd700 1 -- 172.21.15.115:0/3249335414 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc00bbf0 con 0x7f14cc0a4140 2023-09-29T23:06:57.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 -- 172.21.15.115:0/3249335414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc0a4140 msgr2=0x7f14cc0670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:57.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 --2- 172.21.15.115:0/3249335414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc0a4140 0x7f14cc0670a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f14cc06a380 tx=0x7f14bc009250 comp rx=0 tx=0).stop 2023-09-29T23:06:57.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 -- 172.21.15.115:0/3249335414 shutdown_connections 2023-09-29T23:06:57.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 --2- 172.21.15.115:0/3249335414 >> v2:172.21.15.156:3300/0 conn(0x7f14cc067a20 0x7f14cc067e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:57.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 --2- 172.21.15.115:0/3249335414 >> v2:172.21.15.115:3300/0 conn(0x7f14cc09d680 0x7f14cc09da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:57.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 --2- 172.21.15.115:0/3249335414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc0a4140 0x7f14cc0670a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:57.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 -- 172.21.15.115:0/3249335414 >> 172.21.15.115:0/3249335414 conn(0x7f14cc0b1d20 msgr2=0x7f14cc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:57.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 -- 172.21.15.115:0/3249335414 shutdown_connections 2023-09-29T23:06:57.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 -- 172.21.15.115:0/3249335414 wait complete. 2023-09-29T23:06:57.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 Processor -- start 2023-09-29T23:06:57.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 -- start start 2023-09-29T23:06:57.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14cc067a20 0x7f14cc0a2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:57.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc09d680 0x7f14cc097ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:57.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14cc0a4140 0x7f14cc157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:57.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc157ce0 con 0x7f14cc067a20 2023-09-29T23:06:57.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc094a00 con 0x7f14cc0a4140 2023-09-29T23:06:57.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14d0984700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc094bc0 con 0x7f14cc09d680 2023-09-29T23:06:57.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14c3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc09d680 0x7f14cc097ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:57.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14c3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc09d680 0x7f14cc097ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42804/0 (socket says 172.21.15.115:42804) 2023-09-29T23:06:57.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14c3fff700 1 -- 172.21.15.115:0/318655896 learned_addr learned my addr 172.21.15.115:0/318655896 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:06:57.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14cb7fe700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14cc067a20 0x7f14cc0a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:57.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14cbfff700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14cc0a4140 0x7f14cc157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:57.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14c3fff700 1 -- 172.21.15.115:0/318655896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14cc0a4140 msgr2=0x7f14cc157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:57.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14c3fff700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14cc0a4140 0x7f14cc157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:57.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14c3fff700 1 -- 172.21.15.115:0/318655896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14cc067a20 msgr2=0x7f14cc0a2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:57.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14c3fff700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14cc067a20 0x7f14cc0a2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:57.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14c3fff700 1 -- 172.21.15.115:0/318655896 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4009420 con 0x7f14cc09d680 2023-09-29T23:06:57.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.123+0000 7f14c3fff700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc09d680 0x7f14cc097ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f14b400ec80 tx=0x7f14b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:57.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.127+0000 7f14c37fe700 1 -- 172.21.15.115:0/318655896 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b400c8f0 con 0x7f14cc09d680 2023-09-29T23:06:57.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.127+0000 7f14c37fe700 1 -- 172.21.15.115:0/318655896 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b400ca50 con 0x7f14cc09d680 2023-09-29T23:06:57.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.127+0000 7f14d0984700 1 -- 172.21.15.115:0/318655896 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14bc0094f0 con 0x7f14cc09d680 2023-09-29T23:06:57.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.127+0000 7f14c37fe700 1 -- 172.21.15.115:0/318655896 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b400cdd0 con 0x7f14cc09d680 2023-09-29T23:06:57.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.127+0000 7f14d0984700 1 -- 172.21.15.115:0/318655896 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14cc157590 con 0x7f14cc09d680 2023-09-29T23:06:57.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.127+0000 7f14d0984700 1 -- 172.21.15.115:0/318655896 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14cc09b490 con 0x7f14cc09d680 2023-09-29T23:06:57.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.131+0000 7f14c37fe700 1 -- 172.21.15.115:0/318655896 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f14b4013680 con 0x7f14cc09d680 2023-09-29T23:06:57.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.131+0000 7f14c37fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:06:57.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.131+0000 7f14c37fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:06:57.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.131+0000 7f14c37fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:57.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.131+0000 7f14c37fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:06:57.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.131+0000 7f14c37fe700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f14ac08e8e0 0x7f14ac090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:06:57.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.131+0000 7f14c37fe700 1 -- 172.21.15.115:0/318655896 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f14b40b5140 con 0x7f14cc09d680 2023-09-29T23:06:57.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.131+0000 7f14cb7fe700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f14ac08e8e0 0x7f14ac090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:06:57.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.131+0000 7f14cb7fe700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f14ac08e8e0 0x7f14ac090d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f14cc06a380 tx=0x7f14bc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:06:57.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.135+0000 7f14c37fe700 1 -- 172.21.15.115:0/318655896 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f14b4085b70 con 0x7f14cc09d680 2023-09-29T23:06:57.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.323+0000 7f14d0984700 1 -- 172.21.15.115:0/318655896 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f14cc0984f0 con 0x7f14cc09d680 2023-09-29T23:06:57.328 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.323+0000 7f14c37fe700 1 -- 172.21.15.115:0/318655896 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f14cc0984f0 con 0x7f14cc09d680 2023-09-29T23:06:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:06:57.329 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:06:57.332 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.327+0000 7f14d0984700 10 mgrc shutdown 2023-09-29T23:06:57.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.327+0000 7f14d0984700 1 -- 172.21.15.115:0/318655896 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f14ac08e8e0 msgr2=0x7f14ac090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:57.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.327+0000 7f14d0984700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f14ac08e8e0 0x7f14ac090d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f14cc06a380 tx=0x7f14bc017000 comp rx=0 tx=0).stop 2023-09-29T23:06:57.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.327+0000 7f14d0984700 1 -- 172.21.15.115:0/318655896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc09d680 msgr2=0x7f14cc097ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:06:57.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.327+0000 7f14d0984700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc09d680 0x7f14cc097ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f14b400ec80 tx=0x7f14b40091a0 comp rx=0 tx=0).stop 2023-09-29T23:06:57.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.327+0000 7f14d0984700 1 -- 172.21.15.115:0/318655896 shutdown_connections 2023-09-29T23:06:57.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.327+0000 7f14d0984700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14cc0a4140 0x7f14cc157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:57.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.327+0000 7f14d0984700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14cc09d680 0x7f14cc097ed0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:57.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.327+0000 7f14d0984700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f14ac08e8e0 0x7f14ac090d90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:57.333 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.327+0000 7f14d0984700 1 --2- 172.21.15.115:0/318655896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14cc067a20 0x7f14cc0a2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:06:57.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.327+0000 7f14d0984700 1 -- 172.21.15.115:0/318655896 >> 172.21.15.115:0/318655896 conn(0x7f14cc0b1d20 msgr2=0x7f14cc069260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:06:57.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.327+0000 7f14d0984700 1 -- 172.21.15.115:0/318655896 shutdown_connections 2023-09-29T23:06:57.334 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:06:57.327+0000 7f14d0984700 1 -- 172.21.15.115:0/318655896 wait complete. 2023-09-29T23:07:00.348 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:00.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5aca0a700 1 Processor -- start 2023-09-29T23:07:00.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5aca0a700 1 -- start start 2023-09-29T23:07:00.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5aca0a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb5a809b000 0x7fb5a8148360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:00.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5aca0a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb5a8068400 0x7fb5a814a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:00.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5aca0a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a8143570 con 0x7fb5a80a2d40 2023-09-29T23:07:00.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5aca0a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a8143810 con 0x7fb5a8068400 2023-09-29T23:07:00.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5aca0a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a8143ab0 con 0x7fb5a809b000 2023-09-29T23:07:00.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5a7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb5a8068400 0x7fb5a814a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:00.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5a7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb5a8068400 0x7fb5a814a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41456/0 (socket says 172.21.15.115:41456) 2023-09-29T23:07:00.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5a7fff700 1 -- 172.21.15.115:0/595677832 learned_addr learned my addr 172.21.15.115:0/595677832 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:00.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5a7fff700 1 -- 172.21.15.115:0/595677832 >> v2:172.21.15.156:3300/0 conn(0x7fb5a809b000 msgr2=0x7fb5a8148360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-29T23:07:00.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5a7fff700 1 --2- 172.21.15.115:0/595677832 >> v2:172.21.15.156:3300/0 conn(0x7fb5a809b000 0x7fb5a8148360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:00.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5a7fff700 1 -- 172.21.15.115:0/595677832 >> v1:172.21.15.156:6789/0 conn(0x7fb5a80a2d40 legacy=0x7fb5a8135af0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-29T23:07:00.462 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5a7fff700 1 -- 172.21.15.115:0/595677832 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a8064ef0 con 0x7fb5a8068400 2023-09-29T23:07:00.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.454+0000 7fb5a7fff700 1 --2- 172.21.15.115:0/595677832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a8068400 0x7fb5a814a8b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8068260 tx=0x7fb598009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03fba386eb92dc0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:00.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.458+0000 7fb5a67fc700 1 -- 172.21.15.115:0/595677832 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59800b820 con 0x7fb5a8068400 2023-09-29T23:07:00.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.458+0000 7fb5a67fc700 1 -- 172.21.15.115:0/595677832 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59800b980 con 0x7fb5a8068400 2023-09-29T23:07:00.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.458+0000 7fb5a67fc700 1 -- 172.21.15.115:0/595677832 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59800bd20 con 0x7fb5a8068400 2023-09-29T23:07:00.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.458+0000 7fb5aca0a700 1 -- 172.21.15.115:0/595677832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a8068400 msgr2=0x7fb5a814a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:00.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.458+0000 7fb5aca0a700 1 --2- 172.21.15.115:0/595677832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a8068400 0x7fb5a814a8b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8068260 tx=0x7fb598009250 comp rx=0 tx=0).stop 2023-09-29T23:07:00.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.458+0000 7fb5aca0a700 1 -- 172.21.15.115:0/595677832 shutdown_connections 2023-09-29T23:07:00.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.458+0000 7fb5aca0a700 1 --2- 172.21.15.115:0/595677832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a8068400 0x7fb5a814a8b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:00.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.458+0000 7fb5aca0a700 1 --2- 172.21.15.115:0/595677832 >> v2:172.21.15.156:3300/0 conn(0x7fb5a809b000 0x7fb5a8148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:00.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.458+0000 7fb5aca0a700 1 -- 172.21.15.115:0/595677832 >> 172.21.15.115:0/595677832 conn(0x7fb5a80a5160 msgr2=0x7fb5a80a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:00.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.458+0000 7fb5aca0a700 1 -- 172.21.15.115:0/595677832 shutdown_connections 2023-09-29T23:07:00.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.458+0000 7fb5aca0a700 1 -- 172.21.15.115:0/595677832 wait complete. 2023-09-29T23:07:00.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.458+0000 7fb5aca0a700 1 Processor -- start 2023-09-29T23:07:00.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.458+0000 7fb5aca0a700 1 -- start start 2023-09-29T23:07:00.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5aca0a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5a8068400 0x7fb5a80a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:00.467 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5aca0a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5a809b000 0x7fb5a8144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5aca0a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a80a2d40 0x7fb5a8144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5aca0a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a80a9180 con 0x7fb5a80a2d40 2023-09-29T23:07:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5aca0a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a809df70 con 0x7fb5a809b000 2023-09-29T23:07:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5aca0a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a809c8b0 con 0x7fb5a8068400 2023-09-29T23:07:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5a77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5a8068400 0x7fb5a80a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5a77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5a8068400 0x7fb5a80a8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42806/0 (socket says 172.21.15.115:42806) 2023-09-29T23:07:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5a7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a80a2d40 0x7fb5a8144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5a77fe700 1 -- 172.21.15.115:0/3423785512 learned_addr learned my addr 172.21.15.115:0/3423785512 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5a6ffd700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5a809b000 0x7fb5a8144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5a77fe700 1 -- 172.21.15.115:0/3423785512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5a809b000 msgr2=0x7fb5a8144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5a77fe700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5a809b000 0x7fb5a8144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:00.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5a77fe700 1 -- 172.21.15.115:0/3423785512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a80a2d40 msgr2=0x7fb5a8144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5a77fe700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a80a2d40 0x7fb5a8144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5a77fe700 1 -- 172.21.15.115:0/3423785512 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5980094f0 con 0x7fb5a8068400 2023-09-29T23:07:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5a6ffd700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5a809b000 0x7fb5a8144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:07:00.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5a77fe700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5a8068400 0x7fb5a80a8c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000bbe0 tx=0x7fb5a0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:00.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb58f7fe700 1 -- 172.21.15.115:0/3423785512 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a00092e0 con 0x7fb5a8068400 2023-09-29T23:07:00.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb58f7fe700 1 -- 172.21.15.115:0/3423785512 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a000c6f0 con 0x7fb5a8068400 2023-09-29T23:07:00.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5aca0a700 1 -- 172.21.15.115:0/3423785512 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a80a8510 con 0x7fb5a8068400 2023-09-29T23:07:00.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb58f7fe700 1 -- 172.21.15.115:0/3423785512 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a000cab0 con 0x7fb5a8068400 2023-09-29T23:07:00.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5aca0a700 1 -- 172.21.15.115:0/3423785512 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a81451c0 con 0x7fb5a8068400 2023-09-29T23:07:00.470 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.462+0000 7fb5aca0a700 1 -- 172.21.15.115:0/3423785512 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a804be00 con 0x7fb5a8068400 2023-09-29T23:07:00.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.466+0000 7fb58f7fe700 1 -- 172.21.15.115:0/3423785512 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fb5a0012070 con 0x7fb5a8068400 2023-09-29T23:07:00.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.466+0000 7fb58f7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:00.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.466+0000 7fb58f7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:00.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.466+0000 7fb58f7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:00.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.466+0000 7fb58f7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:00.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.466+0000 7fb58f7fe700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb59408e8b0 0x7fb594090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:00.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.466+0000 7fb58f7fe700 1 -- 172.21.15.115:0/3423785512 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fb5a00b48c0 con 0x7fb5a8068400 2023-09-29T23:07:00.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.466+0000 7fb5a6ffd700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb59408e8b0 0x7fb594090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:00.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.470+0000 7fb5a6ffd700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb59408e8b0 0x7fb594090d60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009a80 tx=0x7fb59c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:00.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.470+0000 7fb58f7fe700 1 -- 172.21.15.115:0/3423785512 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb5a00852f0 con 0x7fb5a8068400 2023-09-29T23:07:00.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.666+0000 7fb5aca0a700 1 -- 172.21.15.115:0/3423785512 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb5a80a3110 con 0x7fb5a8068400 2023-09-29T23:07:00.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.666+0000 7fb58f7fe700 1 -- 172.21.15.115:0/3423785512 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fb5a0088910 con 0x7fb5a8068400 2023-09-29T23:07:00.672 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:00.672 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:00.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.670+0000 7fb5aca0a700 10 mgrc shutdown 2023-09-29T23:07:00.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.670+0000 7fb5aca0a700 1 -- 172.21.15.115:0/3423785512 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb59408e8b0 msgr2=0x7fb594090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:00.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.670+0000 7fb5aca0a700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb59408e8b0 0x7fb594090d60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009a80 tx=0x7fb59c008040 comp rx=0 tx=0).stop 2023-09-29T23:07:00.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.670+0000 7fb5aca0a700 1 -- 172.21.15.115:0/3423785512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5a8068400 msgr2=0x7fb5a80a8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:00.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.670+0000 7fb5aca0a700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5a8068400 0x7fb5a80a8c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000bbe0 tx=0x7fb5a0009840 comp rx=0 tx=0).stop 2023-09-29T23:07:00.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.670+0000 7fb5aca0a700 1 -- 172.21.15.115:0/3423785512 shutdown_connections 2023-09-29T23:07:00.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.670+0000 7fb5aca0a700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb59408e8b0 0x7fb594090d60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:00.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.670+0000 7fb5aca0a700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5a80a2d40 0x7fb5a8144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:00.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.670+0000 7fb5aca0a700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5a809b000 0x7fb5a8144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:00.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.670+0000 7fb5aca0a700 1 --2- 172.21.15.115:0/3423785512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb5a8068400 0x7fb5a80a8c40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:00.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.670+0000 7fb5aca0a700 1 -- 172.21.15.115:0/3423785512 >> 172.21.15.115:0/3423785512 conn(0x7fb5a80a5160 msgr2=0x7fb5a80b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:00.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.670+0000 7fb5aca0a700 1 -- 172.21.15.115:0/3423785512 shutdown_connections 2023-09-29T23:07:00.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:00.670+0000 7fb5aca0a700 1 -- 172.21.15.115:0/3423785512 wait complete. 2023-09-29T23:07:03.686 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:03.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.794+0000 7fbee359e700 1 Processor -- start 2023-09-29T23:07:03.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.794+0000 7fbee359e700 1 -- start start 2023-09-29T23:07:03.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee359e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbee409ddb0 0x7fbee4140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:03.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee359e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee413e770 con 0x7fbee413d700 2023-09-29T23:07:03.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee359e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee413dc00 con 0x7fbee409d9e0 2023-09-29T23:07:03.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee359e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee4141d20 con 0x7fbee409ddb0 2023-09-29T23:07:03.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee2d9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbee413d700 0x7fbee40a3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:42752/0 (socket says 172.21.15.115:42752) 2023-09-29T23:07:03.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee2d9d700 1 -- 172.21.15.115:0/3844654616 learned_addr learned my addr 172.21.15.115:0/3844654616 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:07:03.803 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee1d9b700 1 --2- 172.21.15.115:0/3844654616 >> v2:172.21.15.115:3300/0 conn(0x7fbee409ddb0 0x7fbee4140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:03.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee159a700 1 -- 172.21.15.115:0/3844654616 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022720943 0 0) 0x7fbee413e770 con 0x7fbee413d700 2023-09-29T23:07:03.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee159a700 1 -- 172.21.15.115:0/3844654616 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbecc003570 con 0x7fbee413d700 2023-09-29T23:07:03.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee159a700 1 -- 172.21.15.115:0/3844654616 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426853309 0 0) 0x7fbee413dc00 con 0x7fbee409d9e0 2023-09-29T23:07:03.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee1d9b700 1 -- 172.21.15.115:0/3844654616 >> v1:172.21.15.156:6789/0 conn(0x7fbee409d9e0 legacy=0x7fbee4141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:03.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee1d9b700 1 -- 172.21.15.115:0/3844654616 >> v1:172.21.15.115:6789/0 conn(0x7fbee413d700 legacy=0x7fbee40a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:03.804 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee1d9b700 1 -- 172.21.15.115:0/3844654616 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee413dec0 con 0x7fbee409ddb0 2023-09-29T23:07:03.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee1d9b700 1 --2- 172.21.15.115:0/3844654616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbee409ddb0 0x7fbee4140d50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbed40098e0 tx=0x7fbed40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72082f8226aefeca server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:03.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee159a700 1 -- 172.21.15.115:0/3844654616 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed400b6d0 con 0x7fbee409ddb0 2023-09-29T23:07:03.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee159a700 1 -- 172.21.15.115:0/3844654616 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed400b830 con 0x7fbee409ddb0 2023-09-29T23:07:03.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee159a700 1 -- 172.21.15.115:0/3844654616 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed400bbd0 con 0x7fbee409ddb0 2023-09-29T23:07:03.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee359e700 1 -- 172.21.15.115:0/3844654616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbee409ddb0 msgr2=0x7fbee4140d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:03.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee359e700 1 --2- 172.21.15.115:0/3844654616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbee409ddb0 0x7fbee4140d50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbed40098e0 tx=0x7fbed40091a0 comp rx=0 tx=0).stop 2023-09-29T23:07:03.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee359e700 1 -- 172.21.15.115:0/3844654616 shutdown_connections 2023-09-29T23:07:03.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee359e700 1 --2- 172.21.15.115:0/3844654616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbee409ddb0 0x7fbee4140d50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:03.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee359e700 1 -- 172.21.15.115:0/3844654616 >> 172.21.15.115:0/3844654616 conn(0x7fbee40b1d20 msgr2=0x7fbee40b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:03.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee359e700 1 -- 172.21.15.115:0/3844654616 shutdown_connections 2023-09-29T23:07:03.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.798+0000 7fbee359e700 1 -- 172.21.15.115:0/3844654616 wait complete. 2023-09-29T23:07:03.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee359e700 1 Processor -- start 2023-09-29T23:07:03.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee359e700 1 -- start start 2023-09-29T23:07:03.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee359e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbee409d9e0 0x7fbee413c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:03.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbee409ddb0 0x7fbee406e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:03.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee359e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbee413d700 0x7fbee40988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:03.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee359e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee4150cb0 con 0x7fbee413d700 2023-09-29T23:07:03.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee359e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee4097a20 con 0x7fbee409d9e0 2023-09-29T23:07:03.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee413c5c0 con 0x7fbee409ddb0 2023-09-29T23:07:03.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbee413d700 0x7fbee40988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:03.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee1d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbee409ddb0 0x7fbee406e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:03.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee2d9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbee413d700 0x7fbee40988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41474/0 (socket says 172.21.15.115:41474) 2023-09-29T23:07:03.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee2d9d700 1 -- 172.21.15.115:0/1207024314 learned_addr learned my addr 172.21.15.115:0/1207024314 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:03.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee259c700 1 --2- 172.21.15.115:0/1207024314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbee409d9e0 0x7fbee413c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:03.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee2d9d700 1 -- 172.21.15.115:0/1207024314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbee409ddb0 msgr2=0x7fbee406e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:03.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee2d9d700 1 --2- 172.21.15.115:0/1207024314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbee409ddb0 0x7fbee406e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:03.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee2d9d700 1 -- 172.21.15.115:0/1207024314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbee409d9e0 msgr2=0x7fbee413c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:03.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee2d9d700 1 --2- 172.21.15.115:0/1207024314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbee409d9e0 0x7fbee413c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:03.811 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.802+0000 7fbee2d9d700 1 -- 172.21.15.115:0/1207024314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed4009420 con 0x7fbee413d700 2023-09-29T23:07:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.806+0000 7fbee2d9d700 1 --2- 172.21.15.115:0/1207024314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbee413d700 0x7fbee40988e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbedc001460 tx=0x7fbedc001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.806+0000 7fbed27fc700 1 -- 172.21.15.115:0/1207024314 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00a870 con 0x7fbee413d700 2023-09-29T23:07:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.806+0000 7fbed27fc700 1 -- 172.21.15.115:0/1207024314 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc00a9d0 con 0x7fbee413d700 2023-09-29T23:07:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.806+0000 7fbee359e700 1 -- 172.21.15.115:0/1207024314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee4150f00 con 0x7fbee413d700 2023-09-29T23:07:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.806+0000 7fbed27fc700 1 -- 172.21.15.115:0/1207024314 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00ad50 con 0x7fbee413d700 2023-09-29T23:07:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.806+0000 7fbee359e700 1 -- 172.21.15.115:0/1207024314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee406ef90 con 0x7fbee413d700 2023-09-29T23:07:03.812 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.806+0000 7fbee359e700 1 -- 172.21.15.115:0/1207024314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee404be00 con 0x7fbee413d700 2023-09-29T23:07:03.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.810+0000 7fbed27fc700 1 -- 172.21.15.115:0/1207024314 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fbedc007300 con 0x7fbee413d700 2023-09-29T23:07:03.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.810+0000 7fbed27fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:03.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.810+0000 7fbed27fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:03.814 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.810+0000 7fbed27fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:03.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.810+0000 7fbed27fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:03.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.810+0000 7fbed27fc700 1 --2- 172.21.15.115:0/1207024314 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbec408e8b0 0x7fbec4090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:03.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.810+0000 7fbed27fc700 1 -- 172.21.15.115:0/1207024314 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fbedc0b5640 con 0x7fbee413d700 2023-09-29T23:07:03.815 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.810+0000 7fbee259c700 1 --2- 172.21.15.115:0/1207024314 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbec408e8b0 0x7fbec4090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:03.816 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.810+0000 7fbee259c700 1 --2- 172.21.15.115:0/1207024314 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbec408e8b0 0x7fbec4090d60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbed8007fd0 tx=0x7fbed8007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:03.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:03.814+0000 7fbed27fc700 1 -- 172.21.15.115:0/1207024314 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbedc085fe0 con 0x7fbee413d700 2023-09-29T23:07:04.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.010+0000 7fbee359e700 1 -- 172.21.15.115:0/1207024314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbee4095ea0 con 0x7fbee413d700 2023-09-29T23:07:04.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.010+0000 7fbed27fc700 1 -- 172.21.15.115:0/1207024314 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fbedc089600 con 0x7fbee413d700 2023-09-29T23:07:04.017 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:04.017 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:04.019 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.014+0000 7fbee359e700 10 mgrc shutdown 2023-09-29T23:07:04.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.014+0000 7fbee359e700 1 -- 172.21.15.115:0/1207024314 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbec408e8b0 msgr2=0x7fbec4090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:04.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.014+0000 7fbee359e700 1 --2- 172.21.15.115:0/1207024314 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbec408e8b0 0x7fbec4090d60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbed8007fd0 tx=0x7fbed8007d30 comp rx=0 tx=0).stop 2023-09-29T23:07:04.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.014+0000 7fbee359e700 1 -- 172.21.15.115:0/1207024314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbee413d700 msgr2=0x7fbee40988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:04.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.014+0000 7fbee359e700 1 --2- 172.21.15.115:0/1207024314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbee413d700 0x7fbee40988e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbedc001460 tx=0x7fbedc001a40 comp rx=0 tx=0).stop 2023-09-29T23:07:04.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.014+0000 7fbee359e700 1 -- 172.21.15.115:0/1207024314 shutdown_connections 2023-09-29T23:07:04.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.014+0000 7fbee359e700 1 --2- 172.21.15.115:0/1207024314 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fbec408e8b0 0x7fbec4090d60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:04.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.014+0000 7fbee359e700 1 --2- 172.21.15.115:0/1207024314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbee413d700 0x7fbee40988e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:04.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.014+0000 7fbee359e700 1 --2- 172.21.15.115:0/1207024314 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbee409ddb0 0x7fbee406e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:04.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.014+0000 7fbee359e700 1 --2- 172.21.15.115:0/1207024314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbee409d9e0 0x7fbee413c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:04.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.014+0000 7fbee359e700 1 -- 172.21.15.115:0/1207024314 >> 172.21.15.115:0/1207024314 conn(0x7fbee40b1d20 msgr2=0x7fbee4069260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:04.020 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.014+0000 7fbee359e700 1 -- 172.21.15.115:0/1207024314 shutdown_connections 2023-09-29T23:07:04.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:04.014+0000 7fbee359e700 1 -- 172.21.15.115:0/1207024314 wait complete. 2023-09-29T23:07:07.032 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:07.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.138+0000 7f8e42fc4700 1 Processor -- start 2023-09-29T23:07:07.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.138+0000 7f8e42fc4700 1 -- start start 2023-09-29T23:07:07.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.138+0000 7f8e42fc4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8e3c067b60 0x7f8e3c0a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:07.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.138+0000 7f8e42fc4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8e3c06ef70 0x7f8e3c143270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:07.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.138+0000 7f8e42fc4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c0a4830 con 0x7f8e3c0a4370 2023-09-29T23:07:07.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e42fc4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c067f30 con 0x7f8e3c067b60 2023-09-29T23:07:07.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e42fc4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c06fa30 con 0x7f8e3c06ef70 2023-09-29T23:07:07.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e417c1700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8e3c0a4370 0x7f8e3c06e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40082/0 (socket says 172.21.15.115:40082) 2023-09-29T23:07:07.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e41fc2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8e3c067b60 0x7f8e3c0a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:07.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e417c1700 1 -- 172.21.15.115:0/3698400788 learned_addr learned my addr 172.21.15.115:0/3698400788 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:07:07.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e427c3700 1 --2- 172.21.15.115:0/3698400788 >> v2:172.21.15.156:3300/0 conn(0x7f8e3c06ef70 0x7f8e3c143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:07.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e40fc0700 1 -- 172.21.15.115:0/3698400788 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674866723 0 0) 0x7f8e3c0a4830 con 0x7f8e3c0a4370 2023-09-29T23:07:07.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e40fc0700 1 -- 172.21.15.115:0/3698400788 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e28003570 con 0x7f8e3c0a4370 2023-09-29T23:07:07.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e41fc2700 1 -- 172.21.15.115:0/3698400788 >> v2:172.21.15.156:3300/0 conn(0x7f8e3c06ef70 msgr2=0x7f8e3c143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:07.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e41fc2700 1 --2- 172.21.15.115:0/3698400788 >> v2:172.21.15.156:3300/0 conn(0x7f8e3c06ef70 0x7f8e3c143270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:07.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e41fc2700 1 -- 172.21.15.115:0/3698400788 >> v1:172.21.15.115:6789/0 conn(0x7f8e3c0a4370 legacy=0x7f8e3c06e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:07.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e40fc0700 1 -- 172.21.15.115:0/3698400788 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2673322104 0 0) 0x7f8e28003570 con 0x7f8e3c0a4370 2023-09-29T23:07:07.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e41fc2700 1 -- 172.21.15.115:0/3698400788 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c06e410 con 0x7f8e3c067b60 2023-09-29T23:07:07.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e41fc2700 1 --2- 172.21.15.115:0/3698400788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e3c067b60 0x7f8e3c0a3e30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c06c1b0 tx=0x7f8e380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fce0afd2131553e server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:07.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e40fc0700 1 -- 172.21.15.115:0/3698400788 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e300017f0 con 0x7f8e3c067b60 2023-09-29T23:07:07.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e40fc0700 1 -- 172.21.15.115:0/3698400788 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e38011420 con 0x7f8e3c067b60 2023-09-29T23:07:07.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e40fc0700 1 -- 172.21.15.115:0/3698400788 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e380117c0 con 0x7f8e3c067b60 2023-09-29T23:07:07.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3698400788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e3c067b60 msgr2=0x7f8e3c0a3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:07.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e42fc4700 1 --2- 172.21.15.115:0/3698400788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e3c067b60 0x7f8e3c0a3e30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c06c1b0 tx=0x7f8e380091a0 comp rx=0 tx=0).stop 2023-09-29T23:07:07.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3698400788 shutdown_connections 2023-09-29T23:07:07.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e42fc4700 1 --2- 172.21.15.115:0/3698400788 >> v2:172.21.15.156:3300/0 conn(0x7f8e3c06ef70 0x7f8e3c143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:07.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e42fc4700 1 --2- 172.21.15.115:0/3698400788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e3c067b60 0x7f8e3c0a3e30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:07.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3698400788 >> 172.21.15.115:0/3698400788 conn(0x7f8e3c068a40 msgr2=0x7f8e3c068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:07.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3698400788 shutdown_connections 2023-09-29T23:07:07.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.142+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3698400788 wait complete. 2023-09-29T23:07:07.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e42fc4700 1 Processor -- start 2023-09-29T23:07:07.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e42fc4700 1 -- start start 2023-09-29T23:07:07.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e42fc4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e3c067b60 0x7f8e3c09f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:07.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e42fc4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e3c06ef70 0x7f8e3c0a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:07.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e42fc4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e3c0a4370 0x7f8e3c0a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:07.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e42fc4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c0a29b0 con 0x7f8e3c06ef70 2023-09-29T23:07:07.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e42fc4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c0a2110 con 0x7f8e3c067b60 2023-09-29T23:07:07.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e42fc4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c09c690 con 0x7f8e3c0a4370 2023-09-29T23:07:07.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e417c1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e3c06ef70 0x7f8e3c0a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:07.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e417c1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e3c06ef70 0x7f8e3c0a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42980/0 (socket says 172.21.15.115:42980) 2023-09-29T23:07:07.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e417c1700 1 -- 172.21.15.115:0/3436436095 learned_addr learned my addr 172.21.15.115:0/3436436095 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:07.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e427c3700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e3c0a4370 0x7f8e3c0a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:07.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e41fc2700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e3c067b60 0x7f8e3c09f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:07.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e417c1700 1 -- 172.21.15.115:0/3436436095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e3c0a4370 msgr2=0x7f8e3c0a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:07.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e417c1700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e3c0a4370 0x7f8e3c0a1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:07.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e417c1700 1 -- 172.21.15.115:0/3436436095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e3c067b60 msgr2=0x7f8e3c09f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:07.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e417c1700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e3c067b60 0x7f8e3c09f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:07.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e417c1700 1 -- 172.21.15.115:0/3436436095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e38009420 con 0x7f8e3c06ef70 2023-09-29T23:07:07.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e427c3700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e3c0a4370 0x7f8e3c0a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:07:07.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e417c1700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e3c06ef70 0x7f8e3c0a1690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000ccf0 tx=0x7f8e300016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:07.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e2dffb700 1 -- 172.21.15.115:0/3436436095 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30004dc0 con 0x7f8e3c06ef70 2023-09-29T23:07:07.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e2dffb700 1 -- 172.21.15.115:0/3436436095 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3000a620 con 0x7f8e3c06ef70 2023-09-29T23:07:07.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3436436095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c09eaf0 con 0x7f8e3c06ef70 2023-09-29T23:07:07.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e2dffb700 1 -- 172.21.15.115:0/3436436095 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3000a9e0 con 0x7f8e3c06ef70 2023-09-29T23:07:07.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3436436095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3c09e810 con 0x7f8e3c06ef70 2023-09-29T23:07:07.154 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.146+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3436436095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3c04be00 con 0x7f8e3c06ef70 2023-09-29T23:07:07.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.150+0000 7f8e2dffb700 1 -- 172.21.15.115:0/3436436095 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f8e3000ad50 con 0x7f8e3c06ef70 2023-09-29T23:07:07.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.150+0000 7f8e2dffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:07.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.150+0000 7f8e2dffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:07.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.150+0000 7f8e2dffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:07.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.150+0000 7f8e2dffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:07.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.150+0000 7f8e2dffb700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8e2008e8b0 0x7f8e20090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:07.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.150+0000 7f8e2dffb700 1 -- 172.21.15.115:0/3436436095 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f8e300b4330 con 0x7f8e3c06ef70 2023-09-29T23:07:07.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.150+0000 7f8e41fc2700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8e2008e8b0 0x7f8e20090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:07.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.154+0000 7f8e41fc2700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8e2008e8b0 0x7f8e20090d60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c06c1b0 tx=0x7f8e38016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:07.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.158+0000 7f8e2dffb700 1 -- 172.21.15.115:0/3436436095 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8e30084cc0 con 0x7f8e3c06ef70 2023-09-29T23:07:07.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.358+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3436436095 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8e3c1437b0 con 0x7f8e3c06ef70 2023-09-29T23:07:07.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.358+0000 7f8e2dffb700 1 -- 172.21.15.115:0/3436436095 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f8e30018080 con 0x7f8e3c06ef70 2023-09-29T23:07:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:07.364 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:07.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.358+0000 7f8e42fc4700 10 mgrc shutdown 2023-09-29T23:07:07.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.358+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3436436095 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8e2008e8b0 msgr2=0x7f8e20090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:07.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.358+0000 7f8e42fc4700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8e2008e8b0 0x7f8e20090d60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c06c1b0 tx=0x7f8e38016000 comp rx=0 tx=0).stop 2023-09-29T23:07:07.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.358+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3436436095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e3c06ef70 msgr2=0x7f8e3c0a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:07.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.358+0000 7f8e42fc4700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e3c06ef70 0x7f8e3c0a1690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000ccf0 tx=0x7f8e300016f0 comp rx=0 tx=0).stop 2023-09-29T23:07:07.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.358+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3436436095 shutdown_connections 2023-09-29T23:07:07.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.358+0000 7f8e42fc4700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e3c0a4370 0x7f8e3c0a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:07.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.358+0000 7f8e42fc4700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8e2008e8b0 0x7f8e20090d60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:07.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.362+0000 7f8e42fc4700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e3c06ef70 0x7f8e3c0a1690 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:07.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.362+0000 7f8e42fc4700 1 --2- 172.21.15.115:0/3436436095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e3c067b60 0x7f8e3c09f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:07.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.362+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3436436095 >> 172.21.15.115:0/3436436095 conn(0x7f8e3c068a40 msgr2=0x7f8e3c144090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:07.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.362+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3436436095 shutdown_connections 2023-09-29T23:07:07.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:07.362+0000 7f8e42fc4700 1 -- 172.21.15.115:0/3436436095 wait complete. 2023-09-29T23:07:09.005 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:07:09.008 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:07:10.378 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:10.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.486+0000 7f05466f0700 1 Processor -- start 2023-09-29T23:07:10.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.486+0000 7f05466f0700 1 -- start start 2023-09-29T23:07:10.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f054009d9e0 0x7f0540140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:10.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f054009ddb0 0x7f054009f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:10.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054013e770 con 0x7f054013d700 2023-09-29T23:07:10.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0540141d20 con 0x7f054009ddb0 2023-09-29T23:07:10.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054013dc00 con 0x7f054009d9e0 2023-09-29T23:07:10.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05456ee700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f054009d9e0 0x7f0540140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:10.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05456ee700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f054009d9e0 0x7f0540140d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:53168/0 (socket says 172.21.15.115:53168) 2023-09-29T23:07:10.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05456ee700 1 -- 172.21.15.115:0/2935089216 learned_addr learned my addr 172.21.15.115:0/2935089216 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:10.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f0544eed700 1 --2- 172.21.15.115:0/2935089216 >> v2:172.21.15.115:3300/0 conn(0x7f054009ddb0 0x7f054009f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:10.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05456ee700 1 -- 172.21.15.115:0/2935089216 >> v2:172.21.15.115:3300/0 conn(0x7f054009ddb0 msgr2=0x7f054009f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:10.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05456ee700 1 --2- 172.21.15.115:0/2935089216 >> v2:172.21.15.115:3300/0 conn(0x7f054009ddb0 0x7f054009f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:10.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f053ffff700 1 -- 172.21.15.115:0/2935089216 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551534941 0 0) 0x7f054013e770 con 0x7f054013d700 2023-09-29T23:07:10.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05456ee700 1 -- 172.21.15.115:0/2935089216 >> v1:172.21.15.115:6789/0 conn(0x7f054013d700 legacy=0x7f0540141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:10.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05456ee700 1 -- 172.21.15.115:0/2935089216 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054013dec0 con 0x7f054009d9e0 2023-09-29T23:07:10.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05456ee700 1 --2- 172.21.15.115:0/2935089216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f054009d9e0 0x7f0540140d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0530009f20 tx=0x7f0530009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25736dd564926848 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:10.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f053ffff700 1 -- 172.21.15.115:0/2935089216 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053000e070 con 0x7f054009d9e0 2023-09-29T23:07:10.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f053ffff700 1 -- 172.21.15.115:0/2935089216 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053000ba60 con 0x7f054009d9e0 2023-09-29T23:07:10.497 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f053ffff700 1 -- 172.21.15.115:0/2935089216 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05300092e0 con 0x7f054009d9e0 2023-09-29T23:07:10.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 -- 172.21.15.115:0/2935089216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f054009d9e0 msgr2=0x7f0540140d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:10.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 --2- 172.21.15.115:0/2935089216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f054009d9e0 0x7f0540140d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0530009f20 tx=0x7f0530009840 comp rx=0 tx=0).stop 2023-09-29T23:07:10.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 -- 172.21.15.115:0/2935089216 shutdown_connections 2023-09-29T23:07:10.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 --2- 172.21.15.115:0/2935089216 >> v2:172.21.15.115:3300/0 conn(0x7f054009ddb0 0x7f054009f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:10.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 --2- 172.21.15.115:0/2935089216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f054009d9e0 0x7f0540140d50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:10.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 -- 172.21.15.115:0/2935089216 >> 172.21.15.115:0/2935089216 conn(0x7f05400b1d20 msgr2=0x7f05400b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 -- 172.21.15.115:0/2935089216 shutdown_connections 2023-09-29T23:07:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 -- 172.21.15.115:0/2935089216 wait complete. 2023-09-29T23:07:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 Processor -- start 2023-09-29T23:07:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.490+0000 7f05466f0700 1 -- start start 2023-09-29T23:07:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f05466f0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f054009d9e0 0x7f05400a5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f05466f0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f054009ddb0 0x7f05400991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f05466f0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054013d700 0x7f0540099710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f05466f0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540099c50 con 0x7f054013d700 2023-09-29T23:07:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f05466f0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054009bda0 con 0x7f054009d9e0 2023-09-29T23:07:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f05466f0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054009c220 con 0x7f054009ddb0 2023-09-29T23:07:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f0545eef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054013d700 0x7f0540099710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:10.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f0544eed700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f054009ddb0 0x7f05400991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:10.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f0545eef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054013d700 0x7f0540099710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43000/0 (socket says 172.21.15.115:43000) 2023-09-29T23:07:10.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f0545eef700 1 -- 172.21.15.115:0/1220346064 learned_addr learned my addr 172.21.15.115:0/1220346064 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:10.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f05456ee700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f054009d9e0 0x7f05400a5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:10.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f0545eef700 1 -- 172.21.15.115:0/1220346064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f054009ddb0 msgr2=0x7f05400991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:10.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f0545eef700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f054009ddb0 0x7f05400991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:10.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f0545eef700 1 -- 172.21.15.115:0/1220346064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f054009d9e0 msgr2=0x7f05400a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:10.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f0545eef700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f054009d9e0 0x7f05400a5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:10.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f0545eef700 1 -- 172.21.15.115:0/1220346064 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0530009ae0 con 0x7f054013d700 2023-09-29T23:07:10.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f0544eed700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f054009ddb0 0x7f05400991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:07:10.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f0545eef700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054013d700 0x7f0540099710 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f053800c4f0 tx=0x7f0538007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:10.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f053d7fa700 1 -- 172.21.15.115:0/1220346064 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538011590 con 0x7f054013d700 2023-09-29T23:07:10.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f053d7fa700 1 -- 172.21.15.115:0/1220346064 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05380116f0 con 0x7f054013d700 2023-09-29T23:07:10.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f05466f0700 1 -- 172.21.15.115:0/1220346064 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0540152cd0 con 0x7f054013d700 2023-09-29T23:07:10.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f053d7fa700 1 -- 172.21.15.115:0/1220346064 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538011ab0 con 0x7f054013d700 2023-09-29T23:07:10.503 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f05466f0700 1 -- 172.21.15.115:0/1220346064 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054009cba0 con 0x7f054013d700 2023-09-29T23:07:10.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.494+0000 7f05466f0700 1 -- 172.21.15.115:0/1220346064 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0540098ed0 con 0x7f054013d700 2023-09-29T23:07:10.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.498+0000 7f053d7fa700 1 -- 172.21.15.115:0/1220346064 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f053801b3b0 con 0x7f054013d700 2023-09-29T23:07:10.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.498+0000 7f053d7fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:10.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.498+0000 7f053d7fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:10.504 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.498+0000 7f053d7fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:10.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.498+0000 7f053d7fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:10.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.498+0000 7f053d7fa700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f052c08e8b0 0x7f052c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:10.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.498+0000 7f05456ee700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f052c08e8b0 0x7f052c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:10.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.498+0000 7f053d7fa700 1 -- 172.21.15.115:0/1220346064 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f05380b3d30 con 0x7f054013d700 2023-09-29T23:07:10.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.498+0000 7f05456ee700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f052c08e8b0 0x7f052c090d60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0530009880 tx=0x7f0530018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.502+0000 7f053d7fa700 1 -- 172.21.15.115:0/1220346064 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0538084630 con 0x7f054013d700 2023-09-29T23:07:10.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.698+0000 7f05466f0700 1 -- 172.21.15.115:0/1220346064 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f054004be00 con 0x7f054013d700 2023-09-29T23:07:10.703 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.698+0000 7f053d7fa700 1 -- 172.21.15.115:0/1220346064 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f0538017070 con 0x7f054013d700 2023-09-29T23:07:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:10.704 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:10.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.702+0000 7f05466f0700 10 mgrc shutdown 2023-09-29T23:07:10.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.702+0000 7f05466f0700 1 -- 172.21.15.115:0/1220346064 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f052c08e8b0 msgr2=0x7f052c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:10.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.702+0000 7f05466f0700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f052c08e8b0 0x7f052c090d60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0530009880 tx=0x7f0530018000 comp rx=0 tx=0).stop 2023-09-29T23:07:10.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.702+0000 7f05466f0700 1 -- 172.21.15.115:0/1220346064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054013d700 msgr2=0x7f0540099710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:10.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.702+0000 7f05466f0700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054013d700 0x7f0540099710 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f053800c4f0 tx=0x7f0538007f00 comp rx=0 tx=0).stop 2023-09-29T23:07:10.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.702+0000 7f05466f0700 1 -- 172.21.15.115:0/1220346064 shutdown_connections 2023-09-29T23:07:10.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.702+0000 7f05466f0700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f052c08e8b0 0x7f052c090d60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:10.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.702+0000 7f05466f0700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f054013d700 0x7f0540099710 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:10.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.702+0000 7f05466f0700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f054009ddb0 0x7f05400991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:10.708 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.702+0000 7f05466f0700 1 --2- 172.21.15.115:0/1220346064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f054009d9e0 0x7f05400a5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:10.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.702+0000 7f05466f0700 1 -- 172.21.15.115:0/1220346064 >> 172.21.15.115:0/1220346064 conn(0x7f05400b1d20 msgr2=0x7f05400a1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:10.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.702+0000 7f05466f0700 1 -- 172.21.15.115:0/1220346064 shutdown_connections 2023-09-29T23:07:10.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:10.702+0000 7f05466f0700 1 -- 172.21.15.115:0/1220346064 wait complete. 2023-09-29T23:07:13.721 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:13.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.830+0000 7f6db0f18700 1 Processor -- start 2023-09-29T23:07:13.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.830+0000 7f6db0f18700 1 -- start start 2023-09-29T23:07:13.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.830+0000 7f6db0f18700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6dac067b60 0x7f6dac09d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:13.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.830+0000 7f6db0f18700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac09ce00 con 0x7f6dac13fb10 2023-09-29T23:07:13.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.830+0000 7f6db0f18700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac067f30 con 0x7f6dac0a4120 2023-09-29T23:07:13.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.830+0000 7f6db0f18700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac09c630 con 0x7f6dac067b60 2023-09-29T23:07:13.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.830+0000 7f6dab7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6dac067b60 0x7f6dac09d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:13.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.830+0000 7f6dabfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6dac13fb10 0x7f6dac1467c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40096/0 (socket says 172.21.15.115:40096) 2023-09-29T23:07:13.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.830+0000 7f6dabfff700 1 -- 172.21.15.115:0/4268990838 learned_addr learned my addr 172.21.15.115:0/4268990838 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:07:13.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.830+0000 7f6dab7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6dac067b60 0x7f6dac09d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43004/0 (socket says 172.21.15.115:43004) 2023-09-29T23:07:13.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6dab7fe700 1 -- 172.21.15.115:0/4268990838 >> v1:172.21.15.156:6789/0 conn(0x7f6dac0a4120 legacy=0x7f6dac09bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:13.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6dab7fe700 1 -- 172.21.15.115:0/4268990838 >> v1:172.21.15.115:6789/0 conn(0x7f6dac13fb10 legacy=0x7f6dac1467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:13.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6dab7fe700 1 -- 172.21.15.115:0/4268990838 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac09d970 con 0x7f6dac067b60 2023-09-29T23:07:13.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6dab7fe700 1 --2- 172.21.15.115:0/4268990838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac067b60 0x7f6dac09d320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6da00098e0 tx=0x7f6da00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1064570e15ba870 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:13.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6daa7fc700 1 -- 172.21.15.115:0/4268990838 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0009e80 con 0x7f6dac067b60 2023-09-29T23:07:13.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6daa7fc700 1 -- 172.21.15.115:0/4268990838 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da000b860 con 0x7f6dac067b60 2023-09-29T23:07:13.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6daa7fc700 1 -- 172.21.15.115:0/4268990838 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da000bbe0 con 0x7f6dac067b60 2023-09-29T23:07:13.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6db0f18700 1 -- 172.21.15.115:0/4268990838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac067b60 msgr2=0x7f6dac09d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:13.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6db0f18700 1 --2- 172.21.15.115:0/4268990838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac067b60 0x7f6dac09d320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6da00098e0 tx=0x7f6da00091a0 comp rx=0 tx=0).stop 2023-09-29T23:07:13.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6db0f18700 1 -- 172.21.15.115:0/4268990838 shutdown_connections 2023-09-29T23:07:13.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6db0f18700 1 --2- 172.21.15.115:0/4268990838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac067b60 0x7f6dac09d320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:13.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6db0f18700 1 -- 172.21.15.115:0/4268990838 >> 172.21.15.115:0/4268990838 conn(0x7f6dac0b1d20 msgr2=0x7f6dac0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:13.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6db0f18700 1 -- 172.21.15.115:0/4268990838 shutdown_connections 2023-09-29T23:07:13.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.834+0000 7f6db0f18700 1 -- 172.21.15.115:0/4268990838 wait complete. 2023-09-29T23:07:13.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6db0f18700 1 Processor -- start 2023-09-29T23:07:13.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6db0f18700 1 -- start start 2023-09-29T23:07:13.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6db0f18700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac067b60 0x7f6dac09a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:13.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6db0f18700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dac0a4120 0x7f6dac095e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:13.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6db0f18700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dac13fb10 0x7f6dac131870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:13.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6db0f18700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac06e490 con 0x7f6dac067b60 2023-09-29T23:07:13.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6db0f18700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac132980 con 0x7f6dac0a4120 2023-09-29T23:07:13.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6db0f18700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac095740 con 0x7f6dac13fb10 2023-09-29T23:07:13.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6dab7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac067b60 0x7f6dac09a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:13.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6dab7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac067b60 0x7f6dac09a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:43020/0 (socket says 172.21.15.115:43020) 2023-09-29T23:07:13.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6dab7fe700 1 -- 172.21.15.115:0/2755170747 learned_addr learned my addr 172.21.15.115:0/2755170747 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:13.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6dabfff700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dac13fb10 0x7f6dac131870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:13.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6daaffd700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dac0a4120 0x7f6dac095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:13.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6dab7fe700 1 -- 172.21.15.115:0/2755170747 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dac13fb10 msgr2=0x7f6dac131870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:13.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6dab7fe700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dac13fb10 0x7f6dac131870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:13.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6dab7fe700 1 -- 172.21.15.115:0/2755170747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dac0a4120 msgr2=0x7f6dac095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:13.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6dab7fe700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dac0a4120 0x7f6dac095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:13.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6dab7fe700 1 -- 172.21.15.115:0/2755170747 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da0009420 con 0x7f6dac067b60 2023-09-29T23:07:13.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6daaffd700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dac0a4120 0x7f6dac095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:07:13.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6dab7fe700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac067b60 0x7f6dac09a6a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6dac09e240 tx=0x7f6da0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:13.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6d937fe700 1 -- 172.21.15.115:0/2755170747 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da000baa0 con 0x7f6dac067b60 2023-09-29T23:07:13.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6d937fe700 1 -- 172.21.15.115:0/2755170747 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da0025420 con 0x7f6dac067b60 2023-09-29T23:07:13.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6db0f18700 1 -- 172.21.15.115:0/2755170747 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac0954d0 con 0x7f6dac067b60 2023-09-29T23:07:13.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6d937fe700 1 -- 172.21.15.115:0/2755170747 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da00257c0 con 0x7f6dac067b60 2023-09-29T23:07:13.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.838+0000 7f6db0f18700 1 -- 172.21.15.115:0/2755170747 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac0a1300 con 0x7f6dac067b60 2023-09-29T23:07:13.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.842+0000 7f6db0f18700 1 -- 172.21.15.115:0/2755170747 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac04be00 con 0x7f6dac067b60 2023-09-29T23:07:13.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.842+0000 7f6d937fe700 1 -- 172.21.15.115:0/2755170747 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f6da0023070 con 0x7f6dac067b60 2023-09-29T23:07:13.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.842+0000 7f6d937fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:13.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.842+0000 7f6d937fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:13.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.842+0000 7f6d937fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:13.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.842+0000 7f6d937fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:13.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.842+0000 7f6d937fe700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6d9808e8b0 0x7f6d98090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:13.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.846+0000 7f6d937fe700 1 -- 172.21.15.115:0/2755170747 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f6da00b5eb0 con 0x7f6dac067b60 2023-09-29T23:07:13.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.846+0000 7f6daaffd700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6d9808e8b0 0x7f6d98090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:13.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.846+0000 7f6daaffd700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6d9808e8b0 0x7f6d98090d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6dac09c3c0 tx=0x7f6d9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:13.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:13.850+0000 7f6d937fe700 1 -- 172.21.15.115:0/2755170747 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6da00868e0 con 0x7f6dac067b60 2023-09-29T23:07:14.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.042+0000 7f6db0f18700 1 -- 172.21.15.115:0/2755170747 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6dac09f5d0 con 0x7f6dac067b60 2023-09-29T23:07:14.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.042+0000 7f6d937fe700 1 -- 172.21.15.115:0/2755170747 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f6da0015100 con 0x7f6dac067b60 2023-09-29T23:07:14.048 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:14.048 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.046+0000 7f6db0f18700 10 mgrc shutdown 2023-09-29T23:07:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.046+0000 7f6db0f18700 1 -- 172.21.15.115:0/2755170747 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6d9808e8b0 msgr2=0x7f6d98090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.046+0000 7f6db0f18700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6d9808e8b0 0x7f6d98090d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6dac09c3c0 tx=0x7f6d9c009040 comp rx=0 tx=0).stop 2023-09-29T23:07:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.046+0000 7f6db0f18700 1 -- 172.21.15.115:0/2755170747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac067b60 msgr2=0x7f6dac09a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.046+0000 7f6db0f18700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac067b60 0x7f6dac09a6a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6dac09e240 tx=0x7f6da0017000 comp rx=0 tx=0).stop 2023-09-29T23:07:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.046+0000 7f6db0f18700 1 -- 172.21.15.115:0/2755170747 shutdown_connections 2023-09-29T23:07:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.046+0000 7f6db0f18700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dac13fb10 0x7f6dac131870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.046+0000 7f6db0f18700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dac0a4120 0x7f6dac095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:14.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.046+0000 7f6db0f18700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6d9808e8b0 0x7f6d98090d60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:14.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.046+0000 7f6db0f18700 1 --2- 172.21.15.115:0/2755170747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac067b60 0x7f6dac09a6a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:14.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.046+0000 7f6db0f18700 1 -- 172.21.15.115:0/2755170747 >> 172.21.15.115:0/2755170747 conn(0x7f6dac0b1d20 msgr2=0x7f6dac14a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:14.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.046+0000 7f6db0f18700 1 -- 172.21.15.115:0/2755170747 shutdown_connections 2023-09-29T23:07:14.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:14.046+0000 7f6db0f18700 1 -- 172.21.15.115:0/2755170747 wait complete. 2023-09-29T23:07:17.063 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:17.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3fa5533700 1 Processor -- start 2023-09-29T23:07:17.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3fa5533700 1 -- start start 2023-09-29T23:07:17.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3fa5533700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3fa0068480 0x7f3fa009b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:17.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3fa5533700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fa0141570 0x7f3fa01419f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:17.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3fa5533700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa0140ff0 con 0x7f3fa00680b0 2023-09-29T23:07:17.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3fa5533700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa01412b0 con 0x7f3fa0068480 2023-09-29T23:07:17.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3fa5533700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa009ac70 con 0x7f3fa0141570 2023-09-29T23:07:17.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3f9effd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3fa00680b0 0x7f3fa009f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:57484/0 (socket says 172.21.15.115:57484) 2023-09-29T23:07:17.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3f9f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fa0141570 0x7f3fa01419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:17.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3f9effd700 1 -- 172.21.15.115:0/170692887 learned_addr learned my addr 172.21.15.115:0/170692887 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:07:17.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3f9e7fc700 1 --2- 172.21.15.115:0/170692887 >> v2:172.21.15.156:3300/0 conn(0x7f3fa0068480 0x7f3fa009b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:17.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3f9f7fe700 1 -- 172.21.15.115:0/170692887 >> v2:172.21.15.156:3300/0 conn(0x7f3fa0068480 msgr2=0x7f3fa009b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:17.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3f9f7fe700 1 --2- 172.21.15.115:0/170692887 >> v2:172.21.15.156:3300/0 conn(0x7f3fa0068480 0x7f3fa009b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:17.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3f9f7fe700 1 -- 172.21.15.115:0/170692887 >> v1:172.21.15.115:6789/0 conn(0x7f3fa00680b0 legacy=0x7f3fa009f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:17.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3f9dffb700 1 -- 172.21.15.115:0/170692887 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655192953 0 0) 0x7f3fa0140ff0 con 0x7f3fa00680b0 2023-09-29T23:07:17.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.170+0000 7f3f9f7fe700 1 -- 172.21.15.115:0/170692887 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa009ed60 con 0x7f3fa0141570 2023-09-29T23:07:17.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3f9f7fe700 1 --2- 172.21.15.115:0/170692887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fa0141570 0x7f3fa01419f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f980098e0 tx=0x7f3f980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a6f458dd4c28449 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:17.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3f9dffb700 1 -- 172.21.15.115:0/170692887 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98009e80 con 0x7f3fa0141570 2023-09-29T23:07:17.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3f9dffb700 1 -- 172.21.15.115:0/170692887 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9800b860 con 0x7f3fa0141570 2023-09-29T23:07:17.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3f9dffb700 1 -- 172.21.15.115:0/170692887 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9800bbe0 con 0x7f3fa0141570 2023-09-29T23:07:17.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3fa5533700 1 -- 172.21.15.115:0/170692887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fa0141570 msgr2=0x7f3fa01419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:17.184 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3fa5533700 1 --2- 172.21.15.115:0/170692887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fa0141570 0x7f3fa01419f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f980098e0 tx=0x7f3f980091a0 comp rx=0 tx=0).stop 2023-09-29T23:07:17.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3fa5533700 1 -- 172.21.15.115:0/170692887 shutdown_connections 2023-09-29T23:07:17.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3fa5533700 1 --2- 172.21.15.115:0/170692887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fa0141570 0x7f3fa01419f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:17.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3fa5533700 1 --2- 172.21.15.115:0/170692887 >> v2:172.21.15.156:3300/0 conn(0x7f3fa0068480 0x7f3fa009b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:17.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3fa5533700 1 -- 172.21.15.115:0/170692887 >> 172.21.15.115:0/170692887 conn(0x7f3fa00695c0 msgr2=0x7f3fa00699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:17.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3fa5533700 1 -- 172.21.15.115:0/170692887 shutdown_connections 2023-09-29T23:07:17.185 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3fa5533700 1 -- 172.21.15.115:0/170692887 wait complete. 2023-09-29T23:07:17.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3fa5533700 1 Processor -- start 2023-09-29T23:07:17.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.174+0000 7f3fa5533700 1 -- start start 2023-09-29T23:07:17.188 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3fa5533700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa00680b0 0x7f3fa01431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:17.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3fa5533700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fa0068480 0x7f3fa006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:17.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3fa5533700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fa0141570 0x7f3fa013b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:17.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3fa5533700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0095da0 con 0x7f3fa0141570 2023-09-29T23:07:17.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3fa5533700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa006d190 con 0x7f3fa00680b0 2023-09-29T23:07:17.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3fa5533700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa006d430 con 0x7f3fa0068480 2023-09-29T23:07:17.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f9f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fa0141570 0x7f3fa013b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:17.189 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f9e7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fa0068480 0x7f3fa006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:17.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f9f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fa0141570 0x7f3fa013b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59452/0 (socket says 172.21.15.115:59452) 2023-09-29T23:07:17.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f9f7fe700 1 -- 172.21.15.115:0/2790785767 learned_addr learned my addr 172.21.15.115:0/2790785767 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:17.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f9effd700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa00680b0 0x7f3fa01431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:17.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f9effd700 1 -- 172.21.15.115:0/2790785767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fa0068480 msgr2=0x7f3fa006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:17.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f9effd700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fa0068480 0x7f3fa006c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:17.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f9effd700 1 -- 172.21.15.115:0/2790785767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fa0141570 msgr2=0x7f3fa013b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:17.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f9effd700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fa0141570 0x7f3fa013b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:17.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f9effd700 1 -- 172.21.15.115:0/2790785767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f98009420 con 0x7f3fa00680b0 2023-09-29T23:07:17.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f9e7fc700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fa0068480 0x7f3fa006c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:07:17.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f9effd700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa00680b0 0x7f3fa01431d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400c4f0 tx=0x7f3f94007f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:17.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f86ffd700 1 -- 172.21.15.115:0/2790785767 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400cea0 con 0x7f3fa00680b0 2023-09-29T23:07:17.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f86ffd700 1 -- 172.21.15.115:0/2790785767 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f94005b30 con 0x7f3fa00680b0 2023-09-29T23:07:17.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3fa5533700 1 -- 172.21.15.115:0/2790785767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa0096220 con 0x7f3fa00680b0 2023-09-29T23:07:17.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3f86ffd700 1 -- 172.21.15.115:0/2790785767 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f940070d0 con 0x7f3fa00680b0 2023-09-29T23:07:17.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3fa5533700 1 -- 172.21.15.115:0/2790785767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa0143a40 con 0x7f3fa00680b0 2023-09-29T23:07:17.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.178+0000 7f3fa5533700 1 -- 172.21.15.115:0/2790785767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa0095f60 con 0x7f3fa00680b0 2023-09-29T23:07:17.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.182+0000 7f3f86ffd700 1 -- 172.21.15.115:0/2790785767 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f3f940074c0 con 0x7f3fa00680b0 2023-09-29T23:07:17.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.182+0000 7f3f86ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:17.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.182+0000 7f3f86ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:17.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.182+0000 7f3f86ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:17.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.182+0000 7f3f86ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:17.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.182+0000 7f3f86ffd700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3f8c08e930 0x7f3f8c090de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:17.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.182+0000 7f3f86ffd700 1 -- 172.21.15.115:0/2790785767 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f3f940b3f50 con 0x7f3fa00680b0 2023-09-29T23:07:17.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.182+0000 7f3f9e7fc700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3f8c08e930 0x7f3f8c090de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:17.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.182+0000 7f3f9e7fc700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3f8c08e930 0x7f3f8c090de0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00a1f90 tx=0x7f3f90009880 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:17.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.194+0000 7f3f86ffd700 1 -- 172.21.15.115:0/2790785767 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3f94084850 con 0x7f3fa00680b0 2023-09-29T23:07:17.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.386+0000 7f3fa5533700 1 -- 172.21.15.115:0/2790785767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3fa0070990 con 0x7f3fa00680b0 2023-09-29T23:07:17.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.386+0000 7f3f86ffd700 1 -- 172.21.15.115:0/2790785767 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f3f94017020 con 0x7f3fa00680b0 2023-09-29T23:07:17.392 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:17.392 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:17.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.386+0000 7f3fa5533700 10 mgrc shutdown 2023-09-29T23:07:17.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.386+0000 7f3fa5533700 1 -- 172.21.15.115:0/2790785767 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3f8c08e930 msgr2=0x7f3f8c090de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:17.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.386+0000 7f3fa5533700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3f8c08e930 0x7f3f8c090de0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00a1f90 tx=0x7f3f90009880 comp rx=0 tx=0).stop 2023-09-29T23:07:17.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.386+0000 7f3fa5533700 1 -- 172.21.15.115:0/2790785767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa00680b0 msgr2=0x7f3fa01431d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:17.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.386+0000 7f3fa5533700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa00680b0 0x7f3fa01431d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400c4f0 tx=0x7f3f94007f50 comp rx=0 tx=0).stop 2023-09-29T23:07:17.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.386+0000 7f3fa5533700 1 -- 172.21.15.115:0/2790785767 shutdown_connections 2023-09-29T23:07:17.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.386+0000 7f3fa5533700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f3f8c08e930 0x7f3f8c090de0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:17.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.386+0000 7f3fa5533700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fa0141570 0x7f3fa013b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:17.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.386+0000 7f3fa5533700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fa0068480 0x7f3fa006c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:17.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.386+0000 7f3fa5533700 1 --2- 172.21.15.115:0/2790785767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa00680b0 0x7f3fa01431d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:17.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.386+0000 7f3fa5533700 1 -- 172.21.15.115:0/2790785767 >> 172.21.15.115:0/2790785767 conn(0x7f3fa00695c0 msgr2=0x7f3fa0069990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:17.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.390+0000 7f3fa5533700 1 -- 172.21.15.115:0/2790785767 shutdown_connections 2023-09-29T23:07:17.395 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:17.390+0000 7f3fa5533700 1 -- 172.21.15.115:0/2790785767 wait complete. 2023-09-29T23:07:20.406 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:20.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07db59e700 1 Processor -- start 2023-09-29T23:07:20.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07db59e700 1 -- start start 2023-09-29T23:07:20.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07db59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07dc067b60 0x7f07dc09d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:20.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07db59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f07dc0a4120 0x7f07dc09bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:20.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07db59e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc09ce00 con 0x7f07dc0670a0 2023-09-29T23:07:20.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07db59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc067f30 con 0x7f07dc067b60 2023-09-29T23:07:20.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07db59e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc09d970 con 0x7f07dc0a4120 2023-09-29T23:07:20.522 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07dad9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f07dc0670a0 0x7f07dc13fb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:57488/0 (socket says 172.21.15.115:57488) 2023-09-29T23:07:20.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07dad9d700 1 -- 172.21.15.115:0/693945381 learned_addr learned my addr 172.21.15.115:0/693945381 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:07:20.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07da59c700 1 --2- 172.21.15.115:0/693945381 >> v2:172.21.15.115:3300/0 conn(0x7f07dc067b60 0x7f07dc09d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:20.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07d9d9b700 1 --2- 172.21.15.115:0/693945381 >> v2:172.21.15.156:3300/0 conn(0x7f07dc0a4120 0x7f07dc09bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:20.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07d959a700 1 -- 172.21.15.115:0/693945381 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227864659 0 0) 0x7f07dc09ce00 con 0x7f07dc0670a0 2023-09-29T23:07:20.523 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07da59c700 1 -- 172.21.15.115:0/693945381 >> v2:172.21.15.156:3300/0 conn(0x7f07dc0a4120 msgr2=0x7f07dc09bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:20.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07da59c700 1 --2- 172.21.15.115:0/693945381 >> v2:172.21.15.156:3300/0 conn(0x7f07dc0a4120 0x7f07dc09bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:20.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07da59c700 1 -- 172.21.15.115:0/693945381 >> v1:172.21.15.115:6789/0 conn(0x7f07dc0670a0 legacy=0x7f07dc13fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:20.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07da59c700 1 -- 172.21.15.115:0/693945381 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc09dc10 con 0x7f07dc067b60 2023-09-29T23:07:20.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07da59c700 1 --2- 172.21.15.115:0/693945381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07dc067b60 0x7f07dc09d320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f07dc09cf90 tx=0x7f07d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd4e6d231a8e103 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:20.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07d959a700 1 -- 172.21.15.115:0/693945381 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0011630 con 0x7f07dc067b60 2023-09-29T23:07:20.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07d959a700 1 -- 172.21.15.115:0/693945381 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d0011790 con 0x7f07dc067b60 2023-09-29T23:07:20.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.514+0000 7f07d959a700 1 -- 172.21.15.115:0/693945381 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0011b50 con 0x7f07dc067b60 2023-09-29T23:07:20.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 -- 172.21.15.115:0/693945381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07dc067b60 msgr2=0x7f07dc09d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:20.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 --2- 172.21.15.115:0/693945381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07dc067b60 0x7f07dc09d320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f07dc09cf90 tx=0x7f07d00091a0 comp rx=0 tx=0).stop 2023-09-29T23:07:20.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 -- 172.21.15.115:0/693945381 shutdown_connections 2023-09-29T23:07:20.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 --2- 172.21.15.115:0/693945381 >> v2:172.21.15.156:3300/0 conn(0x7f07dc0a4120 0x7f07dc09bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:20.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 --2- 172.21.15.115:0/693945381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07dc067b60 0x7f07dc09d320 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:20.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 -- 172.21.15.115:0/693945381 >> 172.21.15.115:0/693945381 conn(0x7f07dc0b1d20 msgr2=0x7f07dc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:20.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 -- 172.21.15.115:0/693945381 shutdown_connections 2023-09-29T23:07:20.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 -- 172.21.15.115:0/693945381 wait complete. 2023-09-29T23:07:20.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 Processor -- start 2023-09-29T23:07:20.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 -- start start 2023-09-29T23:07:20.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07dc0670a0 0x7f07dc098bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:20.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07dc067b60 0x7f07dc0a7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:20.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07dc0a4120 0x7f07dc097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:20.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc099100 con 0x7f07dc0670a0 2023-09-29T23:07:20.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc0a7c90 con 0x7f07dc0a4120 2023-09-29T23:07:20.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc0a60d0 con 0x7f07dc067b60 2023-09-29T23:07:20.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07da59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07dc0670a0 0x7f07dc098bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:20.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07da59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07dc0670a0 0x7f07dc098bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59470/0 (socket says 172.21.15.115:59470) 2023-09-29T23:07:20.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07da59c700 1 -- 172.21.15.115:0/4095300362 learned_addr learned my addr 172.21.15.115:0/4095300362 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:20.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07d9d9b700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07dc067b60 0x7f07dc0a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:20.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07dad9d700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07dc0a4120 0x7f07dc097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:20.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07da59c700 1 -- 172.21.15.115:0/4095300362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07dc067b60 msgr2=0x7f07dc0a7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:20.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07da59c700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07dc067b60 0x7f07dc0a7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:20.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07da59c700 1 -- 172.21.15.115:0/4095300362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07dc0a4120 msgr2=0x7f07dc097a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:20.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07da59c700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07dc0a4120 0x7f07dc097a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:20.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07da59c700 1 -- 172.21.15.115:0/4095300362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d0009420 con 0x7f07dc0670a0 2023-09-29T23:07:20.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07dad9d700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07dc0a4120 0x7f07dc097a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:07:20.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07da59c700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07dc0670a0 0x7f07dc098bc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f07d0013000 tx=0x7f07d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:20.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07ca7fc700 1 -- 172.21.15.115:0/4095300362 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d001adb0 con 0x7f07dc0670a0 2023-09-29T23:07:20.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07ca7fc700 1 -- 172.21.15.115:0/4095300362 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d001f070 con 0x7f07dc0670a0 2023-09-29T23:07:20.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 -- 172.21.15.115:0/4095300362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc0a6390 con 0x7f07dc0670a0 2023-09-29T23:07:20.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07ca7fc700 1 -- 172.21.15.115:0/4095300362 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d001b6a0 con 0x7f07dc0670a0 2023-09-29T23:07:20.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.518+0000 7f07db59e700 1 -- 172.21.15.115:0/4095300362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc0998d0 con 0x7f07dc0670a0 2023-09-29T23:07:20.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.522+0000 7f07ca7fc700 1 -- 172.21.15.115:0/4095300362 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f07d001ba10 con 0x7f07dc0670a0 2023-09-29T23:07:20.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.522+0000 7f07ca7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:20.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.522+0000 7f07db59e700 1 -- 172.21.15.115:0/4095300362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07dc0a7f60 con 0x7f07dc0670a0 2023-09-29T23:07:20.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.522+0000 7f07ca7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:20.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.522+0000 7f07ca7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:20.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.522+0000 7f07ca7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:20.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.522+0000 7f07ca7fc700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f07bc08e8b0 0x7f07bc090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:20.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.522+0000 7f07ca7fc700 1 -- 172.21.15.115:0/4095300362 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f07d00b5f50 con 0x7f07dc0670a0 2023-09-29T23:07:20.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.522+0000 7f07d9d9b700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f07bc08e8b0 0x7f07bc090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:20.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.526+0000 7f07d9d9b700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f07bc08e8b0 0x7f07bc090d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009fd0 tx=0x7f07cc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:20.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.530+0000 7f07ca7fc700 1 -- 172.21.15.115:0/4095300362 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f07d00868e0 con 0x7f07dc0670a0 2023-09-29T23:07:20.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.726+0000 7f07db59e700 1 -- 172.21.15.115:0/4095300362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f07dc04be00 con 0x7f07dc0670a0 2023-09-29T23:07:20.731 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.726+0000 7f07ca7fc700 1 -- 172.21.15.115:0/4095300362 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f07d0021080 con 0x7f07dc0670a0 2023-09-29T23:07:20.732 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:20.732 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.726+0000 7f07db59e700 10 mgrc shutdown 2023-09-29T23:07:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.726+0000 7f07db59e700 1 -- 172.21.15.115:0/4095300362 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f07bc08e8b0 msgr2=0x7f07bc090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.726+0000 7f07db59e700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f07bc08e8b0 0x7f07bc090d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009fd0 tx=0x7f07cc00b040 comp rx=0 tx=0).stop 2023-09-29T23:07:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.726+0000 7f07db59e700 1 -- 172.21.15.115:0/4095300362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07dc0670a0 msgr2=0x7f07dc098bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.726+0000 7f07db59e700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07dc0670a0 0x7f07dc098bc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f07d0013000 tx=0x7f07d0016000 comp rx=0 tx=0).stop 2023-09-29T23:07:20.734 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.726+0000 7f07db59e700 1 -- 172.21.15.115:0/4095300362 shutdown_connections 2023-09-29T23:07:20.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.726+0000 7f07db59e700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07dc0a4120 0x7f07dc097a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:20.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.726+0000 7f07db59e700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07dc067b60 0x7f07dc0a7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:20.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.726+0000 7f07db59e700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f07bc08e8b0 0x7f07bc090d60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:20.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.726+0000 7f07db59e700 1 --2- 172.21.15.115:0/4095300362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07dc0670a0 0x7f07dc098bc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:20.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.730+0000 7f07db59e700 1 -- 172.21.15.115:0/4095300362 >> 172.21.15.115:0/4095300362 conn(0x7f07dc0b1d20 msgr2=0x7f07dc06eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:20.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.730+0000 7f07db59e700 1 -- 172.21.15.115:0/4095300362 shutdown_connections 2023-09-29T23:07:20.735 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:20.730+0000 7f07db59e700 1 -- 172.21.15.115:0/4095300362 wait complete. 2023-09-29T23:07:23.746 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:23.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.854+0000 7f714fd00700 1 Processor -- start 2023-09-29T23:07:23.861 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.854+0000 7f714fd00700 1 -- start start 2023-09-29T23:07:23.862 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.854+0000 7f714fd00700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71480a69d0 0x7f7148067c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:23.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.854+0000 7f714fd00700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f714809fac0 0x7f714813f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:23.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.854+0000 7f714fd00700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71480a6da0 con 0x7f7148067500 2023-09-29T23:07:23.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.854+0000 7f714fd00700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7148068150 con 0x7f714809fac0 2023-09-29T23:07:23.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.854+0000 7f714fd00700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71480a0070 con 0x7f71480a69d0 2023-09-29T23:07:23.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714e29d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f714809fac0 0x7f714813f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:23.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714e29d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f714809fac0 0x7f714813f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59482/0 (socket says 172.21.15.115:59482) 2023-09-29T23:07:23.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714e29d700 1 -- 172.21.15.115:0/3504231979 learned_addr learned my addr 172.21.15.115:0/3504231979 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:23.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714da9c700 1 --2- 172.21.15.115:0/3504231979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71480a69d0 0x7f7148067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:23.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714e29d700 1 -- 172.21.15.115:0/3504231979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71480a69d0 msgr2=0x7f7148067c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:23.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714e29d700 1 --2- 172.21.15.115:0/3504231979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71480a69d0 0x7f7148067c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:23.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714e29d700 1 -- 172.21.15.115:0/3504231979 >> v1:172.21.15.156:6789/0 conn(0x7f7148067500 legacy=0x7f71480a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:23.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714e29d700 1 -- 172.21.15.115:0/3504231979 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71480a0310 con 0x7f714809fac0 2023-09-29T23:07:23.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714e29d700 1 --2- 172.21.15.115:0/3504231979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714809fac0 0x7f714813f200 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7140009f20 tx=0x7f7140009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a3319ceb900a55 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:23.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714ca9a700 1 -- 172.21.15.115:0/3504231979 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714000e070 con 0x7f714809fac0 2023-09-29T23:07:23.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714ca9a700 1 -- 172.21.15.115:0/3504231979 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714000bb10 con 0x7f714809fac0 2023-09-29T23:07:23.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714ca9a700 1 -- 172.21.15.115:0/3504231979 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400092e0 con 0x7f714809fac0 2023-09-29T23:07:23.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714fd00700 1 -- 172.21.15.115:0/3504231979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714809fac0 msgr2=0x7f714813f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:23.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714fd00700 1 --2- 172.21.15.115:0/3504231979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714809fac0 0x7f714813f200 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7140009f20 tx=0x7f7140009840 comp rx=0 tx=0).stop 2023-09-29T23:07:23.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714fd00700 1 -- 172.21.15.115:0/3504231979 shutdown_connections 2023-09-29T23:07:23.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714fd00700 1 --2- 172.21.15.115:0/3504231979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f714809fac0 0x7f714813f200 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:23.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714fd00700 1 --2- 172.21.15.115:0/3504231979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71480a69d0 0x7f7148067c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:23.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714fd00700 1 -- 172.21.15.115:0/3504231979 >> 172.21.15.115:0/3504231979 conn(0x7f7148085f90 msgr2=0x7f71480a8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:23.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714fd00700 1 -- 172.21.15.115:0/3504231979 shutdown_connections 2023-09-29T23:07:23.865 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714fd00700 1 -- 172.21.15.115:0/3504231979 wait complete. 2023-09-29T23:07:23.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714fd00700 1 Processor -- start 2023-09-29T23:07:23.866 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.858+0000 7f714fd00700 1 -- start start 2023-09-29T23:07:23.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714fd00700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7148067500 0x7f714813b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:23.867 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714fd00700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f714809fac0 0x7f7148096bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:23.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714fd00700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71480a69d0 0x7f7148139a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:23.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714fd00700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7148096480 con 0x7f7148067500 2023-09-29T23:07:23.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714fd00700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71480a5760 con 0x7f71480a69d0 2023-09-29T23:07:23.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714fd00700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71480a5a20 con 0x7f714809fac0 2023-09-29T23:07:23.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714d29b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f714809fac0 0x7f7148096bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:23.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714da9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7148067500 0x7f714813b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:23.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714da9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7148067500 0x7f714813b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59492/0 (socket says 172.21.15.115:59492) 2023-09-29T23:07:23.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714da9c700 1 -- 172.21.15.115:0/3111164270 learned_addr learned my addr 172.21.15.115:0/3111164270 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:23.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714e29d700 1 --2- 172.21.15.115:0/3111164270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71480a69d0 0x7f7148139a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:23.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714da9c700 1 -- 172.21.15.115:0/3111164270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f714809fac0 msgr2=0x7f7148096bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:23.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714da9c700 1 --2- 172.21.15.115:0/3111164270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f714809fac0 0x7f7148096bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:23.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714da9c700 1 -- 172.21.15.115:0/3111164270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71480a69d0 msgr2=0x7f7148139a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:23.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714da9c700 1 --2- 172.21.15.115:0/3111164270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71480a69d0 0x7f7148139a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:23.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714da9c700 1 -- 172.21.15.115:0/3111164270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7140009ae0 con 0x7f7148067500 2023-09-29T23:07:23.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714da9c700 1 --2- 172.21.15.115:0/3111164270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7148067500 0x7f714813b900 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f714400d860 tx=0x7f7144008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:23.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f713dffb700 1 -- 172.21.15.115:0/3111164270 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71440125f0 con 0x7f7148067500 2023-09-29T23:07:23.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f713dffb700 1 -- 172.21.15.115:0/3111164270 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7144012750 con 0x7f7148067500 2023-09-29T23:07:23.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714fd00700 1 -- 172.21.15.115:0/3111164270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71480a5440 con 0x7f7148067500 2023-09-29T23:07:23.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f713dffb700 1 -- 172.21.15.115:0/3111164270 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144012b10 con 0x7f7148067500 2023-09-29T23:07:23.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.862+0000 7f714fd00700 1 -- 172.21.15.115:0/3111164270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7148095a10 con 0x7f7148067500 2023-09-29T23:07:23.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.866+0000 7f714fd00700 1 -- 172.21.15.115:0/3111164270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7148070990 con 0x7f7148067500 2023-09-29T23:07:23.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.866+0000 7f713dffb700 1 -- 172.21.15.115:0/3111164270 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f714401e460 con 0x7f7148067500 2023-09-29T23:07:23.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.866+0000 7f713dffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:23.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.866+0000 7f713dffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:23.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.866+0000 7f713dffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:23.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.866+0000 7f713dffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:23.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.866+0000 7f713dffb700 1 --2- 172.21.15.115:0/3111164270 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f712c08e8b0 0x7f712c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:23.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.866+0000 7f713dffb700 1 -- 172.21.15.115:0/3111164270 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f71440b4e30 con 0x7f7148067500 2023-09-29T23:07:23.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.866+0000 7f714d29b700 1 --2- 172.21.15.115:0/3111164270 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f712c08e8b0 0x7f712c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:23.874 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.870+0000 7f714d29b700 1 --2- 172.21.15.115:0/3111164270 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f712c08e8b0 0x7f712c090d60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7148067a80 tx=0x7f7138007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:23.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:23.874+0000 7f713dffb700 1 -- 172.21.15.115:0/3111164270 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7144089260 con 0x7f7148067500 2023-09-29T23:07:24.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f714fd00700 1 -- 172.21.15.115:0/3111164270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f71480a2390 con 0x7f7148067500 2023-09-29T23:07:24.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f713dffb700 1 -- 172.21.15.115:0/3111164270 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f7144088df0 con 0x7f7148067500 2023-09-29T23:07:24.072 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:24.072 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:24.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f714fd00700 10 mgrc shutdown 2023-09-29T23:07:24.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f714fd00700 1 -- 172.21.15.115:0/3111164270 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f712c08e8b0 msgr2=0x7f712c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:24.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f714fd00700 1 --2- 172.21.15.115:0/3111164270 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f712c08e8b0 0x7f712c090d60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7148067a80 tx=0x7f7138007e80 comp rx=0 tx=0).stop 2023-09-29T23:07:24.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f714fd00700 1 -- 172.21.15.115:0/3111164270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7148067500 msgr2=0x7f714813b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:24.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f714fd00700 1 --2- 172.21.15.115:0/3111164270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7148067500 0x7f714813b900 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f714400d860 tx=0x7f7144008040 comp rx=0 tx=0).stop 2023-09-29T23:07:24.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f714fd00700 1 -- 172.21.15.115:0/3111164270 shutdown_connections 2023-09-29T23:07:24.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f714fd00700 1 --2- 172.21.15.115:0/3111164270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71480a69d0 0x7f7148139a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:24.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f714fd00700 1 --2- 172.21.15.115:0/3111164270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f714809fac0 0x7f7148096bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:24.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f714fd00700 1 --2- 172.21.15.115:0/3111164270 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f712c08e8b0 0x7f712c090d60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:24.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f714fd00700 1 --2- 172.21.15.115:0/3111164270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7148067500 0x7f714813b900 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:24.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f714fd00700 1 -- 172.21.15.115:0/3111164270 >> 172.21.15.115:0/3111164270 conn(0x7f7148085f90 msgr2=0x7f71480a1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:24.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.066+0000 7f714fd00700 1 -- 172.21.15.115:0/3111164270 shutdown_connections 2023-09-29T23:07:24.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:24.070+0000 7f714fd00700 1 -- 172.21.15.115:0/3111164270 wait complete. 2023-09-29T23:07:27.086 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:27.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 Processor -- start 2023-09-29T23:07:27.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 -- start start 2023-09-29T23:07:27.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48d80a6670 0x7f48d8141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:27.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f48d8141ab0 0x7f48d80a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:27.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d806f220 con 0x7f48d80a62a0 2023-09-29T23:07:27.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d8068790 con 0x7f48d8141ab0 2023-09-29T23:07:27.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d80a54a0 con 0x7f48d80a6670 2023-09-29T23:07:27.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48dd81a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48d80a6670 0x7f48d8141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:27.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48de01b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f48d80a62a0 0x7f48d806e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56640/0 (socket says 172.21.15.115:56640) 2023-09-29T23:07:27.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48de01b700 1 -- 172.21.15.115:0/3082814200 learned_addr learned my addr 172.21.15.115:0/3082814200 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:07:27.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48de81c700 1 --2- 172.21.15.115:0/3082814200 >> v2:172.21.15.156:3300/0 conn(0x7f48d8141ab0 0x7f48d80a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:27.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48dd81a700 1 -- 172.21.15.115:0/3082814200 >> v2:172.21.15.156:3300/0 conn(0x7f48d8141ab0 msgr2=0x7f48d80a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:27.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48dd019700 1 -- 172.21.15.115:0/3082814200 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017658471 0 0) 0x7f48d806f220 con 0x7f48d80a62a0 2023-09-29T23:07:27.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48dd81a700 1 --2- 172.21.15.115:0/3082814200 >> v2:172.21.15.156:3300/0 conn(0x7f48d8141ab0 0x7f48d80a4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:27.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48dd81a700 1 -- 172.21.15.115:0/3082814200 >> v1:172.21.15.115:6789/0 conn(0x7f48d80a62a0 legacy=0x7f48d806e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:27.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48dd81a700 1 -- 172.21.15.115:0/3082814200 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d8140e60 con 0x7f48d80a6670 2023-09-29T23:07:27.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48dd81a700 1 --2- 172.21.15.115:0/3082814200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48d80a6670 0x7f48d8141570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f48c80098e0 tx=0x7f48c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86136d81b2a94101 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:27.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48dd019700 1 -- 172.21.15.115:0/3082814200 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c800b640 con 0x7f48d80a6670 2023-09-29T23:07:27.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48dd019700 1 -- 172.21.15.115:0/3082814200 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c800b7a0 con 0x7f48d80a6670 2023-09-29T23:07:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48dd019700 1 -- 172.21.15.115:0/3082814200 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c800bb40 con 0x7f48d80a6670 2023-09-29T23:07:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 -- 172.21.15.115:0/3082814200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48d80a6670 msgr2=0x7f48d8141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 --2- 172.21.15.115:0/3082814200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48d80a6670 0x7f48d8141570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f48c80098e0 tx=0x7f48c80091a0 comp rx=0 tx=0).stop 2023-09-29T23:07:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 -- 172.21.15.115:0/3082814200 shutdown_connections 2023-09-29T23:07:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 --2- 172.21.15.115:0/3082814200 >> v2:172.21.15.156:3300/0 conn(0x7f48d8141ab0 0x7f48d80a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 --2- 172.21.15.115:0/3082814200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48d80a6670 0x7f48d8141570 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 -- 172.21.15.115:0/3082814200 >> 172.21.15.115:0/3082814200 conn(0x7f48d80a3470 msgr2=0x7f48d80a3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 -- 172.21.15.115:0/3082814200 shutdown_connections 2023-09-29T23:07:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.194+0000 7f48df01d700 1 -- 172.21.15.115:0/3082814200 wait complete. 2023-09-29T23:07:27.204 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48df01d700 1 Processor -- start 2023-09-29T23:07:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48df01d700 1 -- start start 2023-09-29T23:07:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48df01d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48d80a62a0 0x7f48d80ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48df01d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48d80a6670 0x7f48d80b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48df01d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48d8141ab0 0x7f48d80b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48df01d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d80acea0 con 0x7f48d80a6670 2023-09-29T23:07:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48df01d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d80b3580 con 0x7f48d80a62a0 2023-09-29T23:07:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48df01d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d80ac490 con 0x7f48d8141ab0 2023-09-29T23:07:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48dd81a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48d80a6670 0x7f48d80b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48de81c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48d8141ab0 0x7f48d80b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48dd81a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48d80a6670 0x7f48d80b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35608/0 (socket says 172.21.15.115:35608) 2023-09-29T23:07:27.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48dd81a700 1 -- 172.21.15.115:0/1270467729 learned_addr learned my addr 172.21.15.115:0/1270467729 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:27.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48de01b700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48d80a62a0 0x7f48d80ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:27.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48de81c700 1 -- 172.21.15.115:0/1270467729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48d80a62a0 msgr2=0x7f48d80ad5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:27.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48de81c700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48d80a62a0 0x7f48d80ad5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:27.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48de81c700 1 -- 172.21.15.115:0/1270467729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48d80a6670 msgr2=0x7f48d80b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:27.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48de81c700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48d80a6670 0x7f48d80b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:27.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48de81c700 1 -- 172.21.15.115:0/1270467729 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c8009420 con 0x7f48d8141ab0 2023-09-29T23:07:27.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48dd81a700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48d80a6670 0x7f48d80b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:07:27.207 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48de81c700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48d8141ab0 0x7f48d80b3d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009e20 tx=0x7f48d000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:27.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48ce7fc700 1 -- 172.21.15.115:0/1270467729 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d000cb30 con 0x7f48d8141ab0 2023-09-29T23:07:27.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48ce7fc700 1 -- 172.21.15.115:0/1270467729 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d000f040 con 0x7f48d8141ab0 2023-09-29T23:07:27.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48df01d700 1 -- 172.21.15.115:0/1270467729 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d80adc70 con 0x7f48d8141ab0 2023-09-29T23:07:27.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48df01d700 1 -- 172.21.15.115:0/1270467729 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d80b4dd0 con 0x7f48d8141ab0 2023-09-29T23:07:27.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48ce7fc700 1 -- 172.21.15.115:0/1270467729 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0014480 con 0x7f48d8141ab0 2023-09-29T23:07:27.208 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.198+0000 7f48df01d700 1 -- 172.21.15.115:0/1270467729 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d80ac6b0 con 0x7f48d8141ab0 2023-09-29T23:07:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.202+0000 7f48ce7fc700 1 -- 172.21.15.115:0/1270467729 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f48d00147f0 con 0x7f48d8141ab0 2023-09-29T23:07:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.202+0000 7f48ce7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.202+0000 7f48ce7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.202+0000 7f48ce7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.202+0000 7f48ce7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.202+0000 7f48ce7fc700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f48bc08e830 0x7f48bc090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:27.209 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.202+0000 7f48ce7fc700 1 -- 172.21.15.115:0/1270467729 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f48d00b5a70 con 0x7f48d8141ab0 2023-09-29T23:07:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.202+0000 7f48de01b700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f48bc08e830 0x7f48bc090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:27.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.202+0000 7f48de01b700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f48bc08e830 0x7f48bc090ce0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f48d4007160 tx=0x7f48d4007f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:27.214 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.206+0000 7f48ce7fc700 1 -- 172.21.15.115:0/1270467729 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f48d0052be0 con 0x7f48d8141ab0 2023-09-29T23:07:27.404 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.398+0000 7f48df01d700 1 -- 172.21.15.115:0/1270467729 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f48d804be00 con 0x7f48d8141ab0 2023-09-29T23:07:27.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.398+0000 7f48ce7fc700 1 -- 172.21.15.115:0/1270467729 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f48d0018080 con 0x7f48d8141ab0 2023-09-29T23:07:27.405 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:27.405 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:27.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.402+0000 7f48df01d700 10 mgrc shutdown 2023-09-29T23:07:27.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.402+0000 7f48df01d700 1 -- 172.21.15.115:0/1270467729 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f48bc08e830 msgr2=0x7f48bc090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:27.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.402+0000 7f48df01d700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f48bc08e830 0x7f48bc090ce0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f48d4007160 tx=0x7f48d4007f50 comp rx=0 tx=0).stop 2023-09-29T23:07:27.409 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.402+0000 7f48df01d700 1 -- 172.21.15.115:0/1270467729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48d8141ab0 msgr2=0x7f48d80b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:27.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.402+0000 7f48df01d700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48d8141ab0 0x7f48d80b3d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009e20 tx=0x7f48d000b040 comp rx=0 tx=0).stop 2023-09-29T23:07:27.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.402+0000 7f48df01d700 1 -- 172.21.15.115:0/1270467729 shutdown_connections 2023-09-29T23:07:27.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.402+0000 7f48df01d700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48d8141ab0 0x7f48d80b3d80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:27.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.402+0000 7f48df01d700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f48bc08e830 0x7f48bc090ce0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:27.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.402+0000 7f48df01d700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48d80a6670 0x7f48d80b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:27.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.402+0000 7f48df01d700 1 --2- 172.21.15.115:0/1270467729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48d80a62a0 0x7f48d80ad5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:27.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.402+0000 7f48df01d700 1 -- 172.21.15.115:0/1270467729 >> 172.21.15.115:0/1270467729 conn(0x7f48d80a3470 msgr2=0x7f48d813df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:27.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.402+0000 7f48df01d700 1 -- 172.21.15.115:0/1270467729 shutdown_connections 2023-09-29T23:07:27.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:27.402+0000 7f48df01d700 1 -- 172.21.15.115:0/1270467729 wait complete. 2023-09-29T23:07:30.425 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:30.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.526+0000 7f72825f2700 1 Processor -- start 2023-09-29T23:07:30.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.526+0000 7f72825f2700 1 -- start start 2023-09-29T23:07:30.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72825f2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f727c067b60 0x7f727c09d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:30.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72825f2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f727c0a4120 0x7f727c09bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:30.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72825f2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c09ce00 con 0x7f727c0670a0 2023-09-29T23:07:30.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72825f2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c067f30 con 0x7f727c0a4120 2023-09-29T23:07:30.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72825f2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c09d970 con 0x7f727c067b60 2023-09-29T23:07:30.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f7280def700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f727c0a4120 0x7f727c09bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:30.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f7281df1700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f727c0670a0 0x7f727c13fb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56656/0 (socket says 172.21.15.115:56656) 2023-09-29T23:07:30.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f7281df1700 1 -- 172.21.15.115:0/3518550798 learned_addr learned my addr 172.21.15.115:0/3518550798 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:07:30.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72815f0700 1 --2- 172.21.15.115:0/3518550798 >> v2:172.21.15.156:3300/0 conn(0x7f727c067b60 0x7f727c09d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:30.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f727bfff700 1 -- 172.21.15.115:0/3518550798 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078283268 0 0) 0x7f727c09ce00 con 0x7f727c0670a0 2023-09-29T23:07:30.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f727bfff700 1 -- 172.21.15.115:0/3518550798 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7264003570 con 0x7f727c0670a0 2023-09-29T23:07:30.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f7280def700 1 -- 172.21.15.115:0/3518550798 >> v2:172.21.15.156:3300/0 conn(0x7f727c067b60 msgr2=0x7f727c09d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:30.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f7280def700 1 --2- 172.21.15.115:0/3518550798 >> v2:172.21.15.156:3300/0 conn(0x7f727c067b60 0x7f727c09d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:30.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f7280def700 1 -- 172.21.15.115:0/3518550798 >> v1:172.21.15.115:6789/0 conn(0x7f727c0670a0 legacy=0x7f727c13fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:30.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f7280def700 1 -- 172.21.15.115:0/3518550798 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c09dc10 con 0x7f727c0a4120 2023-09-29T23:07:30.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f7280def700 1 --2- 172.21.15.115:0/3518550798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f727c0a4120 0x7f727c09bf20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f727c09cf90 tx=0x7f72700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c46b3febaa849f server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:30.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f727bfff700 1 -- 172.21.15.115:0/3518550798 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270011630 con 0x7f727c0a4120 2023-09-29T23:07:30.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f727bfff700 1 -- 172.21.15.115:0/3518550798 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7270011790 con 0x7f727c0a4120 2023-09-29T23:07:30.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f727bfff700 1 -- 172.21.15.115:0/3518550798 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270011b50 con 0x7f727c0a4120 2023-09-29T23:07:30.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72825f2700 1 -- 172.21.15.115:0/3518550798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f727c0a4120 msgr2=0x7f727c09bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:30.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72825f2700 1 --2- 172.21.15.115:0/3518550798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f727c0a4120 0x7f727c09bf20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f727c09cf90 tx=0x7f72700091a0 comp rx=0 tx=0).stop 2023-09-29T23:07:30.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72825f2700 1 -- 172.21.15.115:0/3518550798 shutdown_connections 2023-09-29T23:07:30.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72825f2700 1 --2- 172.21.15.115:0/3518550798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f727c0a4120 0x7f727c09bf20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:30.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72825f2700 1 --2- 172.21.15.115:0/3518550798 >> v2:172.21.15.156:3300/0 conn(0x7f727c067b60 0x7f727c09d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:30.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72825f2700 1 -- 172.21.15.115:0/3518550798 >> 172.21.15.115:0/3518550798 conn(0x7f727c0b1d20 msgr2=0x7f727c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:30.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72825f2700 1 -- 172.21.15.115:0/3518550798 shutdown_connections 2023-09-29T23:07:30.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.530+0000 7f72825f2700 1 -- 172.21.15.115:0/3518550798 wait complete. 2023-09-29T23:07:30.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72825f2700 1 Processor -- start 2023-09-29T23:07:30.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72825f2700 1 -- start start 2023-09-29T23:07:30.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72825f2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f727c0670a0 0x7f727c0a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:30.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72825f2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f727c067b60 0x7f727c0aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:30.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72825f2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f727c0a4120 0x7f727c0a6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:30.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72825f2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0a9bd0 con 0x7f727c0a4120 2023-09-29T23:07:30.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72825f2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0a6040 con 0x7f727c067b60 2023-09-29T23:07:30.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72825f2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0a7af0 con 0x7f727c0670a0 2023-09-29T23:07:30.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f7281df1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f727c0a4120 0x7f727c0a6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:30.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72815f0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f727c0670a0 0x7f727c0a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:30.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f7281df1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f727c0a4120 0x7f727c0a6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35634/0 (socket says 172.21.15.115:35634) 2023-09-29T23:07:30.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f7281df1700 1 -- 172.21.15.115:0/2776043784 learned_addr learned my addr 172.21.15.115:0/2776043784 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:30.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f7280def700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f727c067b60 0x7f727c0aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:30.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f7281df1700 1 -- 172.21.15.115:0/2776043784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f727c0670a0 msgr2=0x7f727c0a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:30.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f7281df1700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f727c0670a0 0x7f727c0a5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:30.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f7281df1700 1 -- 172.21.15.115:0/2776043784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f727c067b60 msgr2=0x7f727c0aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:30.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f7281df1700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f727c067b60 0x7f727c0aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:30.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f7281df1700 1 -- 172.21.15.115:0/2776043784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7270009420 con 0x7f727c0a4120 2023-09-29T23:07:30.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72815f0700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f727c0670a0 0x7f727c0a5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:07:30.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f7281df1700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f727c0a4120 0x7f727c0a6500 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f726c0010e0 tx=0x7f726c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:30.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72797fa700 1 -- 172.21.15.115:0/2776043784 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c005c00 con 0x7f727c0a4120 2023-09-29T23:07:30.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72797fa700 1 -- 172.21.15.115:0/2776043784 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c005d60 con 0x7f727c0a4120 2023-09-29T23:07:30.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72825f2700 1 -- 172.21.15.115:0/2776043784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727c0a7e10 con 0x7f727c0a4120 2023-09-29T23:07:30.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72797fa700 1 -- 172.21.15.115:0/2776043784 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c0072e0 con 0x7f727c0a4120 2023-09-29T23:07:30.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.534+0000 7f72825f2700 1 -- 172.21.15.115:0/2776043784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c0a6a40 con 0x7f727c0a4120 2023-09-29T23:07:30.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.538+0000 7f72825f2700 1 -- 172.21.15.115:0/2776043784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c0a6200 con 0x7f727c0a4120 2023-09-29T23:07:30.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.538+0000 7f72797fa700 1 -- 172.21.15.115:0/2776043784 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f726c012400 con 0x7f727c0a4120 2023-09-29T23:07:30.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.538+0000 7f72797fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:30.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.538+0000 7f72797fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:30.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.538+0000 7f72797fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:30.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.538+0000 7f72797fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:30.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.538+0000 7f72797fa700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f726808e830 0x7f7268090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:30.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.538+0000 7f72797fa700 1 -- 172.21.15.115:0/2776043784 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f726c0b3d20 con 0x7f727c0a4120 2023-09-29T23:07:30.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.538+0000 7f72815f0700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f726808e830 0x7f7268090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:30.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.542+0000 7f72815f0700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f726808e830 0x7f7268090ce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f727400e950 tx=0x7f727400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:30.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.546+0000 7f72797fa700 1 -- 172.21.15.115:0/2776043784 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f726c084630 con 0x7f727c0a4120 2023-09-29T23:07:30.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.738+0000 7f72825f2700 1 -- 172.21.15.115:0/2776043784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f727c04be00 con 0x7f727c0a4120 2023-09-29T23:07:30.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.738+0000 7f72797fa700 1 -- 172.21.15.115:0/2776043784 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f726c017020 con 0x7f727c0a4120 2023-09-29T23:07:30.744 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:30.744 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:30.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.742+0000 7f72825f2700 10 mgrc shutdown 2023-09-29T23:07:30.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.742+0000 7f72825f2700 1 -- 172.21.15.115:0/2776043784 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f726808e830 msgr2=0x7f7268090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:30.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.742+0000 7f72825f2700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f726808e830 0x7f7268090ce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f727400e950 tx=0x7f727400b040 comp rx=0 tx=0).stop 2023-09-29T23:07:30.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.742+0000 7f72825f2700 1 -- 172.21.15.115:0/2776043784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f727c0a4120 msgr2=0x7f727c0a6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:30.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.742+0000 7f72825f2700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f727c0a4120 0x7f727c0a6500 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f726c0010e0 tx=0x7f726c007dd0 comp rx=0 tx=0).stop 2023-09-29T23:07:30.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.742+0000 7f72825f2700 1 -- 172.21.15.115:0/2776043784 shutdown_connections 2023-09-29T23:07:30.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.742+0000 7f72825f2700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f726808e830 0x7f7268090ce0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:30.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.742+0000 7f72825f2700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f727c0a4120 0x7f727c0a6500 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:30.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.742+0000 7f72825f2700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f727c067b60 0x7f727c0aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:30.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.742+0000 7f72825f2700 1 --2- 172.21.15.115:0/2776043784 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f727c0670a0 0x7f727c0a5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:30.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.742+0000 7f72825f2700 1 -- 172.21.15.115:0/2776043784 >> 172.21.15.115:0/2776043784 conn(0x7f727c0b1d20 msgr2=0x7f727c069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:30.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.742+0000 7f72825f2700 1 -- 172.21.15.115:0/2776043784 shutdown_connections 2023-09-29T23:07:30.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:30.742+0000 7f72825f2700 1 -- 172.21.15.115:0/2776043784 wait complete. 2023-09-29T23:07:33.759 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:33.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.866+0000 7fc79f493700 1 Processor -- start 2023-09-29T23:07:33.873 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.866+0000 7fc79f493700 1 -- start start 2023-09-29T23:07:33.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79f493700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc79809dd20 0x7fc79813fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:33.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79f493700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc79809c4a0 0x7fc79809cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:33.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79f493700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79809d0a0 con 0x7fc79809e0f0 2023-09-29T23:07:33.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79f493700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7981402a0 con 0x7fc79809dd20 2023-09-29T23:07:33.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79f493700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc798140560 con 0x7fc79809c4a0 2023-09-29T23:07:33.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79e491700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc79809dd20 0x7fc79813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:33.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79e491700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc79809dd20 0x7fc79813fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35648/0 (socket says 172.21.15.115:35648) 2023-09-29T23:07:33.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79e491700 1 -- 172.21.15.115:0/4292831299 learned_addr learned my addr 172.21.15.115:0/4292831299 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:33.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79dc90700 1 --2- 172.21.15.115:0/4292831299 >> v2:172.21.15.156:3300/0 conn(0x7fc79809c4a0 0x7fc79809cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:33.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79e491700 1 -- 172.21.15.115:0/4292831299 >> v2:172.21.15.156:3300/0 conn(0x7fc79809c4a0 msgr2=0x7fc79809cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:33.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79e491700 1 --2- 172.21.15.115:0/4292831299 >> v2:172.21.15.156:3300/0 conn(0x7fc79809c4a0 0x7fc79809cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:33.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79e491700 1 -- 172.21.15.115:0/4292831299 >> v1:172.21.15.156:6789/0 conn(0x7fc79809e0f0 legacy=0x7fc79813bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:33.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79e491700 1 -- 172.21.15.115:0/4292831299 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79813d470 con 0x7fc79809dd20 2023-09-29T23:07:33.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79e491700 1 --2- 172.21.15.115:0/4292831299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79809dd20 0x7fc79813fc70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc79809f130 tx=0x7fc79400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97051cd1c53c3128 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:33.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79d48f700 1 -- 172.21.15.115:0/4292831299 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79400dc50 con 0x7fc79809dd20 2023-09-29T23:07:33.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79d48f700 1 -- 172.21.15.115:0/4292831299 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79400ddb0 con 0x7fc79809dd20 2023-09-29T23:07:33.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79d48f700 1 -- 172.21.15.115:0/4292831299 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7940196b0 con 0x7fc79809dd20 2023-09-29T23:07:33.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79f493700 1 -- 172.21.15.115:0/4292831299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79809dd20 msgr2=0x7fc79813fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:33.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79f493700 1 --2- 172.21.15.115:0/4292831299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79809dd20 0x7fc79813fc70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc79809f130 tx=0x7fc79400b4f0 comp rx=0 tx=0).stop 2023-09-29T23:07:33.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79f493700 1 -- 172.21.15.115:0/4292831299 shutdown_connections 2023-09-29T23:07:33.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79f493700 1 --2- 172.21.15.115:0/4292831299 >> v2:172.21.15.156:3300/0 conn(0x7fc79809c4a0 0x7fc79809cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:33.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79f493700 1 --2- 172.21.15.115:0/4292831299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79809dd20 0x7fc79813fc70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:33.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79f493700 1 -- 172.21.15.115:0/4292831299 >> 172.21.15.115:0/4292831299 conn(0x7fc7980a2a60 msgr2=0x7fc7980a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:33.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79f493700 1 -- 172.21.15.115:0/4292831299 shutdown_connections 2023-09-29T23:07:33.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.870+0000 7fc79f493700 1 -- 172.21.15.115:0/4292831299 wait complete. 2023-09-29T23:07:33.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79f493700 1 Processor -- start 2023-09-29T23:07:33.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79f493700 1 -- start start 2023-09-29T23:07:33.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79f493700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79809c4a0 0x7fc798152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:33.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79f493700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc79809dd20 0x7fc798144d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:33.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79f493700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc79809e0f0 0x7fc798145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79f493700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc798153020 con 0x7fc79809c4a0 2023-09-29T23:07:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79f493700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc798098ef0 con 0x7fc79809e0f0 2023-09-29T23:07:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79f493700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc798099170 con 0x7fc79809dd20 2023-09-29T23:07:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79e491700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79809c4a0 0x7fc798152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79e491700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79809c4a0 0x7fc798152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35652/0 (socket says 172.21.15.115:35652) 2023-09-29T23:07:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79e491700 1 -- 172.21.15.115:0/3169123636 learned_addr learned my addr 172.21.15.115:0/3169123636 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79dc90700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc79809dd20 0x7fc798144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79ec92700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc79809e0f0 0x7fc798145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.874+0000 7fc79e491700 1 -- 172.21.15.115:0/3169123636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc79809dd20 msgr2=0x7fc798144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.878+0000 7fc79e491700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc79809dd20 0x7fc798144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.878+0000 7fc79e491700 1 -- 172.21.15.115:0/3169123636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc79809e0f0 msgr2=0x7fc798145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.878+0000 7fc79e491700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc79809e0f0 0x7fc798145260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.878+0000 7fc79e491700 1 -- 172.21.15.115:0/3169123636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79400b790 con 0x7fc79809c4a0 2023-09-29T23:07:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.878+0000 7fc79ec92700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc79809e0f0 0x7fc798145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:07:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.878+0000 7fc79dc90700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc79809dd20 0x7fc798144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:07:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.878+0000 7fc79e491700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79809c4a0 0x7fc798152840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc79809d230 tx=0x7fc79401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.878+0000 7fc78e7fc700 1 -- 172.21.15.115:0/3169123636 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794010700 con 0x7fc79809c4a0 2023-09-29T23:07:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.878+0000 7fc78e7fc700 1 -- 172.21.15.115:0/3169123636 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc794010860 con 0x7fc79809c4a0 2023-09-29T23:07:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.878+0000 7fc79f493700 1 -- 172.21.15.115:0/3169123636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7981534b0 con 0x7fc79809c4a0 2023-09-29T23:07:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.878+0000 7fc78e7fc700 1 -- 172.21.15.115:0/3169123636 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794010c20 con 0x7fc79809c4a0 2023-09-29T23:07:33.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.878+0000 7fc79f493700 1 -- 172.21.15.115:0/3169123636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7981457a0 con 0x7fc79809c4a0 2023-09-29T23:07:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.878+0000 7fc79f493700 1 -- 172.21.15.115:0/3169123636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79804be00 con 0x7fc79809c4a0 2023-09-29T23:07:33.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.882+0000 7fc78e7fc700 1 -- 172.21.15.115:0/3169123636 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc794023600 con 0x7fc79809c4a0 2023-09-29T23:07:33.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.882+0000 7fc78e7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.882+0000 7fc78e7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.882+0000 7fc78e7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.882+0000 7fc78e7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.882+0000 7fc78e7fc700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc77c08e8b0 0x7fc77c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.882+0000 7fc78e7fc700 1 -- 172.21.15.115:0/3169123636 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fc794014070 con 0x7fc79809c4a0 2023-09-29T23:07:33.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.882+0000 7fc79dc90700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc77c08e8b0 0x7fc77c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:33.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.882+0000 7fc79dc90700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc77c08e8b0 0x7fc77c090d60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc79813fa00 tx=0x7fc788008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:33.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:33.886+0000 7fc78e7fc700 1 -- 172.21.15.115:0/3169123636 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc794087150 con 0x7fc79809c4a0 2023-09-29T23:07:34.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.086+0000 7fc79f493700 1 -- 172.21.15.115:0/3169123636 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc798069790 con 0x7fc79809c4a0 2023-09-29T23:07:34.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.086+0000 7fc78e7fc700 1 -- 172.21.15.115:0/3169123636 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fc79400b5a0 con 0x7fc79809c4a0 2023-09-29T23:07:34.093 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:34.093 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:34.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.090+0000 7fc79f493700 10 mgrc shutdown 2023-09-29T23:07:34.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.090+0000 7fc79f493700 1 -- 172.21.15.115:0/3169123636 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc77c08e8b0 msgr2=0x7fc77c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.090+0000 7fc79f493700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc77c08e8b0 0x7fc77c090d60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc79813fa00 tx=0x7fc788008040 comp rx=0 tx=0).stop 2023-09-29T23:07:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.090+0000 7fc79f493700 1 -- 172.21.15.115:0/3169123636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79809c4a0 msgr2=0x7fc798152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.090+0000 7fc79f493700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79809c4a0 0x7fc798152840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc79809d230 tx=0x7fc79401b000 comp rx=0 tx=0).stop 2023-09-29T23:07:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.090+0000 7fc79f493700 1 -- 172.21.15.115:0/3169123636 shutdown_connections 2023-09-29T23:07:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.090+0000 7fc79f493700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc79809e0f0 0x7fc798145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.090+0000 7fc79f493700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc79809dd20 0x7fc798144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.090+0000 7fc79f493700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc77c08e8b0 0x7fc77c090d60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.090+0000 7fc79f493700 1 --2- 172.21.15.115:0/3169123636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79809c4a0 0x7fc798152840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.090+0000 7fc79f493700 1 -- 172.21.15.115:0/3169123636 >> 172.21.15.115:0/3169123636 conn(0x7fc7980a2a60 msgr2=0x7fc7980677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:34.096 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.090+0000 7fc79f493700 1 -- 172.21.15.115:0/3169123636 shutdown_connections 2023-09-29T23:07:34.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:34.090+0000 7fc79f493700 1 -- 172.21.15.115:0/3169123636 wait complete. 2023-09-29T23:07:37.108 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:37.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc360850700 1 Processor -- start 2023-09-29T23:07:37.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc360850700 1 -- start start 2023-09-29T23:07:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc360850700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc35c0a0f50 0x7fc35c1480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc360850700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c13c680 con 0x7fc35c0a32d0 2023-09-29T23:07:37.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc360850700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c13fd50 con 0x7fc35c0a36a0 2023-09-29T23:07:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc360850700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c13fff0 con 0x7fc35c0a0f50 2023-09-29T23:07:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc35ad9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc35c0a32d0 0x7fc35c09e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:45362/0 (socket says 172.21.15.115:45362) 2023-09-29T23:07:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc35ad9d700 1 -- 172.21.15.115:0/4216566661 learned_addr learned my addr 172.21.15.115:0/4216566661 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:07:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc35b59e700 1 --2- 172.21.15.115:0/4216566661 >> v2:172.21.15.156:3300/0 conn(0x7fc35c0a0f50 0x7fc35c1480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599060733 0 0) 0x7fc35c13c680 con 0x7fc35c0a32d0 2023-09-29T23:07:37.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc344003570 con 0x7fc35c0a32d0 2023-09-29T23:07:37.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375350983 0 0) 0x7fc35c13fd50 con 0x7fc35c0a36a0 2023-09-29T23:07:37.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc35c13c680 con 0x7fc35c0a36a0 2023-09-29T23:07:37.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1313700109 0 0) 0x7fc344003570 con 0x7fc35c0a32d0 2023-09-29T23:07:37.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 >> v2:172.21.15.156:3300/0 conn(0x7fc35c0a0f50 msgr2=0x7fc35c1480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:37.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc359d9b700 1 --2- 172.21.15.115:0/4216566661 >> v2:172.21.15.156:3300/0 conn(0x7fc35c0a0f50 0x7fc35c1480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:37.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.214+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 >> v1:172.21.15.156:6789/0 conn(0x7fc35c0a36a0 legacy=0x7fc35c09c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:37.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c140290 con 0x7fc35c0a32d0 2023-09-29T23:07:37.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3987234196 0 0) 0x7fc350001470 con 0x7fc35c0a32d0 2023-09-29T23:07:37.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 >> v1:172.21.15.115:6789/0 conn(0x7fc35c0a32d0 legacy=0x7fc35c09e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:37.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc359d9b700 1 --2- 172.21.15.115:0/4216566661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc344003c40 0x7fc344004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:37.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc359d9b700 1 --2- 172.21.15.115:0/4216566661 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc344004810 0x7fc344004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:37.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc359d9b700 1 --2- 172.21.15.115:0/4216566661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc344005210 0x7fc34400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:37.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c13fff0 con 0x7fc344003c40 2023-09-29T23:07:37.226 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34400c1b0 con 0x7fc344005210 2023-09-29T23:07:37.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34400c370 con 0x7fc344004810 2023-09-29T23:07:37.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc35ad9d700 1 --2- 172.21.15.115:0/4216566661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc344003c40 0x7fc344004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:37.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc35a59c700 1 --2- 172.21.15.115:0/4216566661 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc344004810 0x7fc344004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:37.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc35b59e700 1 --2- 172.21.15.115:0/4216566661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc344005210 0x7fc34400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:37.227 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc35a59c700 1 -- 172.21.15.115:0/4216566661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc344005210 msgr2=0x7fc34400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc35a59c700 1 --2- 172.21.15.115:0/4216566661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc344005210 0x7fc34400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc35a59c700 1 -- 172.21.15.115:0/4216566661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc344003c40 msgr2=0x7fc344004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc35a59c700 1 --2- 172.21.15.115:0/4216566661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc344003c40 0x7fc344004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc35a59c700 1 -- 172.21.15.115:0/4216566661 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc344003570 con 0x7fc344004810 2023-09-29T23:07:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc35b59e700 1 --2- 172.21.15.115:0/4216566661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc344005210 0x7fc34400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:07:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc35b59e700 1 -- 172.21.15.115:0/4216566661 reap_dead start 2023-09-29T23:07:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc35a59c700 1 --2- 172.21.15.115:0/4216566661 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc344004810 0x7fc344004c80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0019e0 tx=0x7fc34c007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13f2f58497de1bea server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00c5d0 con 0x7fc344004810 2023-09-29T23:07:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c00c730 con 0x7fc344004810 2023-09-29T23:07:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc359d9b700 1 -- 172.21.15.115:0/4216566661 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00caf0 con 0x7fc344004810 2023-09-29T23:07:37.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc360850700 1 -- 172.21.15.115:0/4216566661 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc344004810 msgr2=0x7fc344004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:37.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc360850700 1 --2- 172.21.15.115:0/4216566661 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc344004810 0x7fc344004c80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0019e0 tx=0x7fc34c007d30 comp rx=0 tx=0).stop 2023-09-29T23:07:37.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc360850700 1 -- 172.21.15.115:0/4216566661 shutdown_connections 2023-09-29T23:07:37.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc360850700 1 --2- 172.21.15.115:0/4216566661 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc344004810 0x7fc344004c80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:37.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc360850700 1 -- 172.21.15.115:0/4216566661 >> 172.21.15.115:0/4216566661 conn(0x7fc35c0b1d20 msgr2=0x7fc35c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:37.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc360850700 1 -- 172.21.15.115:0/4216566661 shutdown_connections 2023-09-29T23:07:37.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.218+0000 7fc360850700 1 -- 172.21.15.115:0/4216566661 wait complete. 2023-09-29T23:07:37.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc360850700 1 Processor -- start 2023-09-29T23:07:37.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc360850700 1 -- start start 2023-09-29T23:07:37.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc360850700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc344004810 0x7fc35c09a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:37.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc360850700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc35c0b1620 0x7fc35c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:37.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc360850700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc35c13eb20 0x7fc35c13ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:37.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc360850700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c06e5d0 con 0x7fc35c0b1620 2023-09-29T23:07:37.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc360850700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c06db90 con 0x7fc35c13eb20 2023-09-29T23:07:37.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc360850700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c06c920 con 0x7fc344004810 2023-09-29T23:07:37.231 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc35a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc35c0b1620 0x7fc35c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:37.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc35a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc35c0b1620 0x7fc35c06e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48092/0 (socket says 172.21.15.115:48092) 2023-09-29T23:07:37.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc35a59c700 1 -- 172.21.15.115:0/279348761 learned_addr learned my addr 172.21.15.115:0/279348761 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:37.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc35ad9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc344004810 0x7fc35c09a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:37.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc35b59e700 1 --2- 172.21.15.115:0/279348761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc35c13eb20 0x7fc35c13ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:37.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc35a59c700 1 -- 172.21.15.115:0/279348761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc344004810 msgr2=0x7fc35c09a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:37.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc35a59c700 1 --2- 172.21.15.115:0/279348761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc344004810 0x7fc35c09a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:37.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc35a59c700 1 -- 172.21.15.115:0/279348761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc35c13eb20 msgr2=0x7fc35c13ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:37.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc35a59c700 1 --2- 172.21.15.115:0/279348761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc35c13eb20 0x7fc35c13ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:37.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc35a59c700 1 -- 172.21.15.115:0/279348761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c06cbe0 con 0x7fc35c0b1620 2023-09-29T23:07:37.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc35a59c700 1 --2- 172.21.15.115:0/279348761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc35c0b1620 0x7fc35c06e090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00c3c0 tx=0x7fc34c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:37.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc342ffd700 1 -- 172.21.15.115:0/279348761 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00c5d0 con 0x7fc35c0b1620 2023-09-29T23:07:37.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc342ffd700 1 -- 172.21.15.115:0/279348761 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c00cab0 con 0x7fc35c0b1620 2023-09-29T23:07:37.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc360850700 1 -- 172.21.15.115:0/279348761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c150390 con 0x7fc35c0b1620 2023-09-29T23:07:37.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc342ffd700 1 -- 172.21.15.115:0/279348761 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c006a50 con 0x7fc35c0b1620 2023-09-29T23:07:37.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.222+0000 7fc360850700 1 -- 172.21.15.115:0/279348761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c099470 con 0x7fc35c0b1620 2023-09-29T23:07:37.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.226+0000 7fc360850700 1 -- 172.21.15.115:0/279348761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c04be00 con 0x7fc35c0b1620 2023-09-29T23:07:37.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.226+0000 7fc342ffd700 1 -- 172.21.15.115:0/279348761 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc34c019070 con 0x7fc35c0b1620 2023-09-29T23:07:37.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.226+0000 7fc342ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:37.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.226+0000 7fc342ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:37.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.226+0000 7fc342ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:37.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.226+0000 7fc342ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:37.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.226+0000 7fc342ffd700 1 --2- 172.21.15.115:0/279348761 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc34808e830 0x7fc348090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:37.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.226+0000 7fc342ffd700 1 -- 172.21.15.115:0/279348761 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fc34c0b6640 con 0x7fc35c0b1620 2023-09-29T23:07:37.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.226+0000 7fc35ad9d700 1 --2- 172.21.15.115:0/279348761 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc34808e830 0x7fc348090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:37.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.230+0000 7fc35ad9d700 1 --2- 172.21.15.115:0/279348761 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc34808e830 0x7fc348090ce0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc350000e50 tx=0x7fc35c140420 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:37.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.234+0000 7fc342ffd700 1 -- 172.21.15.115:0/279348761 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc34c087070 con 0x7fc35c0b1620 2023-09-29T23:07:37.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.434+0000 7fc360850700 1 -- 172.21.15.115:0/279348761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc35c0a4280 con 0x7fc35c0b1620 2023-09-29T23:07:37.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.434+0000 7fc342ffd700 1 -- 172.21.15.115:0/279348761 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fc34c08a690 con 0x7fc35c0b1620 2023-09-29T23:07:37.441 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:37.441 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:37.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.438+0000 7fc360850700 10 mgrc shutdown 2023-09-29T23:07:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.438+0000 7fc360850700 1 -- 172.21.15.115:0/279348761 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc34808e830 msgr2=0x7fc348090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.438+0000 7fc360850700 1 --2- 172.21.15.115:0/279348761 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc34808e830 0x7fc348090ce0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc350000e50 tx=0x7fc35c140420 comp rx=0 tx=0).stop 2023-09-29T23:07:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.438+0000 7fc360850700 1 -- 172.21.15.115:0/279348761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc35c0b1620 msgr2=0x7fc35c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.438+0000 7fc360850700 1 --2- 172.21.15.115:0/279348761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc35c0b1620 0x7fc35c06e090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00c3c0 tx=0x7fc34c015000 comp rx=0 tx=0).stop 2023-09-29T23:07:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.438+0000 7fc360850700 1 -- 172.21.15.115:0/279348761 shutdown_connections 2023-09-29T23:07:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.438+0000 7fc360850700 1 --2- 172.21.15.115:0/279348761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc35c13eb20 0x7fc35c13ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.438+0000 7fc360850700 1 --2- 172.21.15.115:0/279348761 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc34808e830 0x7fc348090ce0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.438+0000 7fc360850700 1 --2- 172.21.15.115:0/279348761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc35c0b1620 0x7fc35c06e090 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.438+0000 7fc360850700 1 --2- 172.21.15.115:0/279348761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc344004810 0x7fc35c09a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:37.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.438+0000 7fc360850700 1 -- 172.21.15.115:0/279348761 >> 172.21.15.115:0/279348761 conn(0x7fc35c0b1d20 msgr2=0x7fc35c0672b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:37.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.438+0000 7fc360850700 1 -- 172.21.15.115:0/279348761 shutdown_connections 2023-09-29T23:07:37.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:37.438+0000 7fc360850700 1 -- 172.21.15.115:0/279348761 wait complete. 2023-09-29T23:07:39.085 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:07:39.087 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:07:40.455 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:40.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6751f700 1 Processor -- start 2023-09-29T23:07:40.567 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6751f700 1 -- start start 2023-09-29T23:07:40.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6751f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 0x7f5f6006e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:40.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6751f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5f600a4a40 0x7f5f60148160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:40.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6751f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6006f220 con 0x7f5f600a6670 2023-09-29T23:07:40.568 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6751f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f60068790 con 0x7f5f600a4a40 2023-09-29T23:07:40.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6751f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f60141c80 con 0x7f5f600a62a0 2023-09-29T23:07:40.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6651d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 0x7f5f6006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:40.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6651d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 0x7f5f6006e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:36982/0 (socket says 172.21.15.115:36982) 2023-09-29T23:07:40.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6651d700 1 -- 172.21.15.115:0/2170469432 learned_addr learned my addr 172.21.15.115:0/2170469432 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:40.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f66d1e700 1 --2- 172.21.15.115:0/2170469432 >> v2:172.21.15.156:3300/0 conn(0x7f5f600a4a40 0x7f5f60148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:40.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6651d700 1 -- 172.21.15.115:0/2170469432 >> v2:172.21.15.156:3300/0 conn(0x7f5f600a4a40 msgr2=0x7f5f60148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:40.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6651d700 1 --2- 172.21.15.115:0/2170469432 >> v2:172.21.15.156:3300/0 conn(0x7f5f600a4a40 0x7f5f60148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:40.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6651d700 1 -- 172.21.15.115:0/2170469432 >> v1:172.21.15.156:6789/0 conn(0x7f5f600a6670 legacy=0x7f5f60141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:40.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6651d700 1 -- 172.21.15.115:0/2170469432 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f600a54a0 con 0x7f5f600a62a0 2023-09-29T23:07:40.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6651d700 1 --2- 172.21.15.115:0/2170469432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 0x7f5f6006e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0099b0 tx=0x7f5f5c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda8564c76d5edf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:40.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6551b700 1 -- 172.21.15.115:0/2170469432 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00b860 con 0x7f5f600a62a0 2023-09-29T23:07:40.569 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6551b700 1 -- 172.21.15.115:0/2170469432 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c00b9c0 con 0x7f5f600a62a0 2023-09-29T23:07:40.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6551b700 1 -- 172.21.15.115:0/2170469432 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00bd60 con 0x7f5f600a62a0 2023-09-29T23:07:40.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6751f700 1 -- 172.21.15.115:0/2170469432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 msgr2=0x7f5f6006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:40.570 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6751f700 1 --2- 172.21.15.115:0/2170469432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 0x7f5f6006e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0099b0 tx=0x7f5f5c009250 comp rx=0 tx=0).stop 2023-09-29T23:07:40.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6751f700 1 -- 172.21.15.115:0/2170469432 shutdown_connections 2023-09-29T23:07:40.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6751f700 1 --2- 172.21.15.115:0/2170469432 >> v2:172.21.15.156:3300/0 conn(0x7f5f600a4a40 0x7f5f60148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:40.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6751f700 1 --2- 172.21.15.115:0/2170469432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 0x7f5f6006e770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:40.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.562+0000 7f5f6751f700 1 -- 172.21.15.115:0/2170469432 >> 172.21.15.115:0/2170469432 conn(0x7f5f600a3470 msgr2=0x7f5f600a3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:40.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.566+0000 7f5f6751f700 1 -- 172.21.15.115:0/2170469432 shutdown_connections 2023-09-29T23:07:40.571 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.566+0000 7f5f6751f700 1 -- 172.21.15.115:0/2170469432 wait complete. 2023-09-29T23:07:40.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.566+0000 7f5f6751f700 1 Processor -- start 2023-09-29T23:07:40.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.566+0000 7f5f6751f700 1 -- start start 2023-09-29T23:07:40.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f6751f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f600a4a40 0x7f5f600ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:40.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f6751f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 0x7f5f600aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:40.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f6751f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f600a6670 0x7f5f60142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:40.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f6751f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f600aa5b0 con 0x7f5f600a6670 2023-09-29T23:07:40.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f6751f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f600ab690 con 0x7f5f600a4a40 2023-09-29T23:07:40.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f6751f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f600ab950 con 0x7f5f600a62a0 2023-09-29T23:07:40.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f65d1c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 0x7f5f600aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:40.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f65d1c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 0x7f5f600aacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:36986/0 (socket says 172.21.15.115:36986) 2023-09-29T23:07:40.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f65d1c700 1 -- 172.21.15.115:0/363294584 learned_addr learned my addr 172.21.15.115:0/363294584 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:40.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f66d1e700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f600a6670 0x7f5f60142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:40.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f6651d700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f600a4a40 0x7f5f600ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:40.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f65d1c700 1 -- 172.21.15.115:0/363294584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f600a4a40 msgr2=0x7f5f600ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:40.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f65d1c700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f600a4a40 0x7f5f600ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:40.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f65d1c700 1 -- 172.21.15.115:0/363294584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f600a6670 msgr2=0x7f5f60142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:40.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f65d1c700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f600a6670 0x7f5f60142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:40.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f65d1c700 1 -- 172.21.15.115:0/363294584 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c0094f0 con 0x7f5f600a62a0 2023-09-29T23:07:40.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f65d1c700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 0x7f5f600aacc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000c4e0 tx=0x7f5f50007f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:40.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f567fc700 1 -- 172.21.15.115:0/363294584 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5000ce90 con 0x7f5f600a62a0 2023-09-29T23:07:40.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f567fc700 1 -- 172.21.15.115:0/363294584 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f50011590 con 0x7f5f600a62a0 2023-09-29T23:07:40.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f6751f700 1 -- 172.21.15.115:0/363294584 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f600abc10 con 0x7f5f600a62a0 2023-09-29T23:07:40.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f567fc700 1 -- 172.21.15.115:0/363294584 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50011950 con 0x7f5f600a62a0 2023-09-29T23:07:40.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f6751f700 1 -- 172.21.15.115:0/363294584 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f600a9f10 con 0x7f5f600a62a0 2023-09-29T23:07:40.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.570+0000 7f5f6751f700 1 -- 172.21.15.115:0/363294584 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f600ace50 con 0x7f5f600a62a0 2023-09-29T23:07:40.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.574+0000 7f5f567fc700 1 -- 172.21.15.115:0/363294584 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f5f50011d00 con 0x7f5f600a62a0 2023-09-29T23:07:40.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.574+0000 7f5f567fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:40.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.574+0000 7f5f567fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:40.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.574+0000 7f5f567fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:40.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.574+0000 7f5f567fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:40.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.574+0000 7f5f567fc700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5f4408e8b0 0x7f5f44090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:40.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.574+0000 7f5f567fc700 1 -- 172.21.15.115:0/363294584 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f5f500b3fc0 con 0x7f5f600a62a0 2023-09-29T23:07:40.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.574+0000 7f5f6651d700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5f4408e8b0 0x7f5f44090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:40.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.574+0000 7f5f6651d700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5f4408e8b0 0x7f5f44090d60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0099b0 tx=0x7f5f5c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:40.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.578+0000 7f5f567fc700 1 -- 172.21.15.115:0/363294584 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5f50084960 con 0x7f5f600a62a0 2023-09-29T23:07:40.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.778+0000 7f5f6751f700 1 -- 172.21.15.115:0/363294584 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5f6004be00 con 0x7f5f600a62a0 2023-09-29T23:07:40.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.778+0000 7f5f567fc700 1 -- 172.21.15.115:0/363294584 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f5f50017080 con 0x7f5f600a62a0 2023-09-29T23:07:40.784 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:40.784 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:40.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.778+0000 7f5f6751f700 10 mgrc shutdown 2023-09-29T23:07:40.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.782+0000 7f5f6751f700 1 -- 172.21.15.115:0/363294584 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5f4408e8b0 msgr2=0x7f5f44090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:40.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.782+0000 7f5f6751f700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5f4408e8b0 0x7f5f44090d60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0099b0 tx=0x7f5f5c017000 comp rx=0 tx=0).stop 2023-09-29T23:07:40.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.782+0000 7f5f6751f700 1 -- 172.21.15.115:0/363294584 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 msgr2=0x7f5f600aacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:40.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.782+0000 7f5f6751f700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 0x7f5f600aacc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000c4e0 tx=0x7f5f50007f00 comp rx=0 tx=0).stop 2023-09-29T23:07:40.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.782+0000 7f5f6751f700 1 -- 172.21.15.115:0/363294584 shutdown_connections 2023-09-29T23:07:40.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.782+0000 7f5f6751f700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f5f4408e8b0 0x7f5f44090d60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:40.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.782+0000 7f5f6751f700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f600a6670 0x7f5f60142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:40.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.782+0000 7f5f6751f700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5f600a62a0 0x7f5f600aacc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:40.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.782+0000 7f5f6751f700 1 --2- 172.21.15.115:0/363294584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f600a4a40 0x7f5f600ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:40.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.782+0000 7f5f6751f700 1 -- 172.21.15.115:0/363294584 >> 172.21.15.115:0/363294584 conn(0x7f5f600a3470 msgr2=0x7f5f60139820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:40.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.782+0000 7f5f6751f700 1 -- 172.21.15.115:0/363294584 shutdown_connections 2023-09-29T23:07:40.787 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:40.782+0000 7f5f6751f700 1 -- 172.21.15.115:0/363294584 wait complete. 2023-09-29T23:07:43.800 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:43.917 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.909+0000 7f457169f700 1 Processor -- start 2023-09-29T23:07:43.933 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.909+0000 7f457169f700 1 -- start start 2023-09-29T23:07:43.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f457169f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 0x7f456c0a2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:43.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f457169f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f456c067470 0x7f456c0a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:43.937 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f457169f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456c09fb40 con 0x7f456c13be80 2023-09-29T23:07:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f457169f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456c13ca70 con 0x7f456c067470 2023-09-29T23:07:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f457169f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c13cd30 con 0x7f456c0670a0 2023-09-29T23:07:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f4563fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 0x7f456c0a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f456b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f456c067470 0x7f456c0a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f4563fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 0x7f456c0a2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:36998/0 (socket says 172.21.15.115:36998) 2023-09-29T23:07:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f4563fff700 1 -- 172.21.15.115:0/1580951113 learned_addr learned my addr 172.21.15.115:0/1580951113 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f456b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f456c067470 0x7f456c0a0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48102/0 (socket says 172.21.15.115:48102) 2023-09-29T23:07:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f4563fff700 1 -- 172.21.15.115:0/1580951113 >> v2:172.21.15.115:3300/0 conn(0x7f456c067470 msgr2=0x7f456c0a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f4563fff700 1 --2- 172.21.15.115:0/1580951113 >> v2:172.21.15.115:3300/0 conn(0x7f456c067470 0x7f456c0a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:43.938 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f4563fff700 1 -- 172.21.15.115:0/1580951113 >> v1:172.21.15.156:6789/0 conn(0x7f456c13be80 legacy=0x7f456c13c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f4563fff700 1 -- 172.21.15.115:0/1580951113 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c0a25d0 con 0x7f456c0670a0 2023-09-29T23:07:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f4563fff700 1 --2- 172.21.15.115:0/1580951113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 0x7f456c0a2090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f455400bc50 tx=0x7f455400b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a649e61de22054c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f456a7fc700 1 -- 172.21.15.115:0/1580951113 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455400dbf0 con 0x7f456c0670a0 2023-09-29T23:07:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f456a7fc700 1 -- 172.21.15.115:0/1580951113 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455400dd50 con 0x7f456c0670a0 2023-09-29T23:07:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f456a7fc700 1 -- 172.21.15.115:0/1580951113 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540196b0 con 0x7f456c0670a0 2023-09-29T23:07:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f457169f700 1 -- 172.21.15.115:0/1580951113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 msgr2=0x7f456c0a2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f457169f700 1 --2- 172.21.15.115:0/1580951113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 0x7f456c0a2090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f455400bc50 tx=0x7f455400b4f0 comp rx=0 tx=0).stop 2023-09-29T23:07:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f457169f700 1 -- 172.21.15.115:0/1580951113 shutdown_connections 2023-09-29T23:07:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f457169f700 1 --2- 172.21.15.115:0/1580951113 >> v2:172.21.15.115:3300/0 conn(0x7f456c067470 0x7f456c0a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f457169f700 1 --2- 172.21.15.115:0/1580951113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 0x7f456c0a2090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f457169f700 1 -- 172.21.15.115:0/1580951113 >> 172.21.15.115:0/1580951113 conn(0x7f456c0b3160 msgr2=0x7f456c06eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f457169f700 1 -- 172.21.15.115:0/1580951113 shutdown_connections 2023-09-29T23:07:43.939 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.913+0000 7f457169f700 1 -- 172.21.15.115:0/1580951113 wait complete. 2023-09-29T23:07:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f457169f700 1 Processor -- start 2023-09-29T23:07:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f457169f700 1 -- start start 2023-09-29T23:07:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f457169f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 0x7f456c06de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f457169f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f456c067470 0x7f456c137d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f457169f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f456c13be80 0x7f456c14e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f457169f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c06e8f0 con 0x7f456c13be80 2023-09-29T23:07:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f457169f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c14efd0 con 0x7f456c067470 2023-09-29T23:07:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f457169f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c14f290 con 0x7f456c0670a0 2023-09-29T23:07:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f456b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f456c13be80 0x7f456c14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f456affd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 0x7f456c06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f456b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f456c13be80 0x7f456c14e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48112/0 (socket says 172.21.15.115:48112) 2023-09-29T23:07:43.940 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f456affd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 0x7f456c06de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:37014/0 (socket says 172.21.15.115:37014) 2023-09-29T23:07:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f456b7fe700 1 -- 172.21.15.115:0/3295285472 learned_addr learned my addr 172.21.15.115:0/3295285472 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f4563fff700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f456c067470 0x7f456c137d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f456affd700 1 -- 172.21.15.115:0/3295285472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f456c067470 msgr2=0x7f456c137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f456affd700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f456c067470 0x7f456c137d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f456affd700 1 -- 172.21.15.115:0/3295285472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f456c13be80 msgr2=0x7f456c14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f456affd700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f456c13be80 0x7f456c14e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f456affd700 1 -- 172.21.15.115:0/3295285472 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455400b790 con 0x7f456c0670a0 2023-09-29T23:07:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f456b7fe700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f456c13be80 0x7f456c14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:07:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f456affd700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 0x7f456c06de70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f455c00c490 tx=0x7f455c007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f4562ffd700 1 -- 172.21.15.115:0/3295285472 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c012420 con 0x7f456c0670a0 2023-09-29T23:07:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f4562ffd700 1 -- 172.21.15.115:0/3295285472 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455c0125a0 con 0x7f456c0670a0 2023-09-29T23:07:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f457169f700 1 -- 172.21.15.115:0/3295285472 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c1376d0 con 0x7f456c0670a0 2023-09-29T23:07:43.941 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f4562ffd700 1 -- 172.21.15.115:0/3295285472 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c012960 con 0x7f456c0670a0 2023-09-29T23:07:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.917+0000 7f457169f700 1 -- 172.21.15.115:0/3295285472 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456c098cc0 con 0x7f456c0670a0 2023-09-29T23:07:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.921+0000 7f457169f700 1 -- 172.21.15.115:0/3295285472 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456c1379d0 con 0x7f456c0670a0 2023-09-29T23:07:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.921+0000 7f4562ffd700 1 -- 172.21.15.115:0/3295285472 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f455c01b3b0 con 0x7f456c0670a0 2023-09-29T23:07:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.921+0000 7f4562ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.921+0000 7f4562ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.921+0000 7f4562ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.921+0000 7f4562ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.921+0000 7f4562ffd700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f454c08e8e0 0x7f454c090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.921+0000 7f4562ffd700 1 -- 172.21.15.115:0/3295285472 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f455c0b4270 con 0x7f456c0670a0 2023-09-29T23:07:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.921+0000 7f4563fff700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f454c08e8e0 0x7f454c090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.925+0000 7f4563fff700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f454c08e8e0 0x7f454c090d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f455400bc50 tx=0x7f455401b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:43.942 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:43.925+0000 7f4562ffd700 1 -- 172.21.15.115:0/3295285472 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f455c084c10 con 0x7f456c0670a0 2023-09-29T23:07:44.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 1 -- 172.21.15.115:0/3295285472 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f456c1379d0 con 0x7f456c0670a0 2023-09-29T23:07:44.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f4562ffd700 1 -- 172.21.15.115:0/3295285472 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f456c1379d0 con 0x7f456c0670a0 2023-09-29T23:07:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:44.131 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 10 mgrc shutdown 2023-09-29T23:07:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 1 -- 172.21.15.115:0/3295285472 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f454c08e8e0 msgr2=0x7f454c090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f454c08e8e0 0x7f454c090d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f455400bc50 tx=0x7f455401b000 comp rx=0 tx=0).stop 2023-09-29T23:07:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 1 -- 172.21.15.115:0/3295285472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 msgr2=0x7f456c06de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 0x7f456c06de70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f455c00c490 tx=0x7f455c007eb0 comp rx=0 tx=0).stop 2023-09-29T23:07:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 1 -- 172.21.15.115:0/3295285472 shutdown_connections 2023-09-29T23:07:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f454c08e8e0 0x7f454c090d90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f456c13be80 0x7f456c14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f456c067470 0x7f456c137d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:44.134 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 1 --2- 172.21.15.115:0/3295285472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f456c0670a0 0x7f456c06de70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:44.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 1 -- 172.21.15.115:0/3295285472 >> 172.21.15.115:0/3295285472 conn(0x7f456c0b3160 msgr2=0x7f456c067930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:44.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 1 -- 172.21.15.115:0/3295285472 shutdown_connections 2023-09-29T23:07:44.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:44.125+0000 7f457169f700 1 -- 172.21.15.115:0/3295285472 wait complete. 2023-09-29T23:07:47.146 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:47.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 Processor -- start 2023-09-29T23:07:47.261 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 -- start start 2023-09-29T23:07:47.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dd009b190 0x7f2dd00680b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:47.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2dd009de30 0x7f2dd013fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:47.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2dd009e240 0x7f2dd01402c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:47.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd009b560 con 0x7f2dd009de30 2023-09-29T23:07:47.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd0140c30 con 0x7f2dd009e240 2023-09-29T23:07:47.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd0140970 con 0x7f2dd009b190 2023-09-29T23:07:47.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dc7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2dd009de30 0x7f2dd013fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd4ce7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dd009b190 0x7f2dd00680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dc7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2dd009de30 0x7f2dd013fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48960/0 (socket says 172.21.15.115:48960) 2023-09-29T23:07:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dc7fff700 1 -- 172.21.15.115:0/1730899038 learned_addr learned my addr 172.21.15.115:0/1730899038 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd54e8700 1 --2- 172.21.15.115:0/1730899038 >> v2:172.21.15.156:3300/0 conn(0x7f2dd009e240 0x7f2dd01402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dc7fff700 1 -- 172.21.15.115:0/1730899038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dd009b190 msgr2=0x7f2dd00680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dc7fff700 1 --2- 172.21.15.115:0/1730899038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dd009b190 0x7f2dd00680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dc7fff700 1 -- 172.21.15.115:0/1730899038 >> v2:172.21.15.156:3300/0 conn(0x7f2dd009e240 msgr2=0x7f2dd01402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dc7fff700 1 --2- 172.21.15.115:0/1730899038 >> v2:172.21.15.156:3300/0 conn(0x7f2dd009e240 0x7f2dd01402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dc7fff700 1 -- 172.21.15.115:0/1730899038 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd009d020 con 0x7f2dd009de30 2023-09-29T23:07:47.264 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dc7fff700 1 --2- 172.21.15.115:0/1730899038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd009de30 0x7f2dd013fd80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2dd009d270 tx=0x7f2dc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302595582649e81f server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:47.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dc77fe700 1 -- 172.21.15.115:0/1730899038 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0011630 con 0x7f2dd009de30 2023-09-29T23:07:47.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dc77fe700 1 -- 172.21.15.115:0/1730899038 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc0011790 con 0x7f2dd009de30 2023-09-29T23:07:47.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dc77fe700 1 -- 172.21.15.115:0/1730899038 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0011b50 con 0x7f2dd009de30 2023-09-29T23:07:47.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/1730899038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd009de30 msgr2=0x7f2dd013fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:47.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 --2- 172.21.15.115:0/1730899038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd009de30 0x7f2dd013fd80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2dd009d270 tx=0x7f2dc0009250 comp rx=0 tx=0).stop 2023-09-29T23:07:47.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/1730899038 shutdown_connections 2023-09-29T23:07:47.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 --2- 172.21.15.115:0/1730899038 >> v2:172.21.15.156:3300/0 conn(0x7f2dd009e240 0x7f2dd01402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:47.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 --2- 172.21.15.115:0/1730899038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd009de30 0x7f2dd013fd80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:47.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 --2- 172.21.15.115:0/1730899038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dd009b190 0x7f2dd00680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:47.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/1730899038 >> 172.21.15.115:0/1730899038 conn(0x7f2dd00695c0 msgr2=0x7f2dd00699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:47.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/1730899038 shutdown_connections 2023-09-29T23:07:47.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.257+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/1730899038 wait complete. 2023-09-29T23:07:47.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd6f4b700 1 Processor -- start 2023-09-29T23:07:47.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd6f4b700 1 -- start start 2023-09-29T23:07:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd6f4b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd009b190 0x7f2dd0143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd6f4b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dd009de30 0x7f2dd006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd6f4b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2dd009e240 0x7f2dd006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd6f4b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd0142720 con 0x7f2dd009b190 2023-09-29T23:07:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd6f4b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd006d340 con 0x7f2dd009e240 2023-09-29T23:07:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd6f4b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd006d600 con 0x7f2dd009de30 2023-09-29T23:07:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd4ce7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd009b190 0x7f2dd0143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:47.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dc7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dd009de30 0x7f2dd006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:47.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dc7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dd009de30 0x7f2dd006c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:48766/0 (socket says 172.21.15.115:48766) 2023-09-29T23:07:47.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd4ce7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd009b190 0x7f2dd0143150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48976/0 (socket says 172.21.15.115:48976) 2023-09-29T23:07:47.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dc7fff700 1 -- 172.21.15.115:0/3782644551 learned_addr learned my addr 172.21.15.115:0/3782644551 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:47.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd54e8700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2dd009e240 0x7f2dd006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:47.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dc7fff700 1 -- 172.21.15.115:0/3782644551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2dd009e240 msgr2=0x7f2dd006cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:47.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dc7fff700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2dd009e240 0x7f2dd006cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:47.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dc7fff700 1 -- 172.21.15.115:0/3782644551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd009b190 msgr2=0x7f2dd0143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:47.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dc7fff700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd009b190 0x7f2dd0143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dc7fff700 1 -- 172.21.15.115:0/3782644551 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc00094f0 con 0x7f2dd009de30 2023-09-29T23:07:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd4ce7700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd009b190 0x7f2dd0143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:07:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dc7fff700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dd009de30 0x7f2dd006c7c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009290 tx=0x7f2dc0016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dc4ff9700 1 -- 172.21.15.115:0/3782644551 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc001bd00 con 0x7f2dd009de30 2023-09-29T23:07:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dc4ff9700 1 -- 172.21.15.115:0/3782644551 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc0020070 con 0x7f2dd009de30 2023-09-29T23:07:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/3782644551 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd006e870 con 0x7f2dd009de30 2023-09-29T23:07:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dc4ff9700 1 -- 172.21.15.115:0/3782644551 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc001bea0 con 0x7f2dd009de30 2023-09-29T23:07:47.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.261+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/3782644551 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd013be10 con 0x7f2dd009de30 2023-09-29T23:07:47.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.265+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/3782644551 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd013c000 con 0x7f2dd009de30 2023-09-29T23:07:47.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.273+0000 7f2dc4ff9700 1 -- 172.21.15.115:0/3782644551 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f2dc001c450 con 0x7f2dd009de30 2023-09-29T23:07:47.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.273+0000 7f2dc4ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:47.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.273+0000 7f2dc4ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:47.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.273+0000 7f2dc4ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:47.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.273+0000 7f2dc4ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:47.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.273+0000 7f2dc4ff9700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2dbc08e8e0 0x7f2dbc090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:47.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.273+0000 7f2dc4ff9700 1 -- 172.21.15.115:0/3782644551 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f2dc0022070 con 0x7f2dd009de30 2023-09-29T23:07:47.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.273+0000 7f2dd4ce7700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2dbc08e8e0 0x7f2dbc090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:47.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.273+0000 7f2dd4ce7700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2dbc08e8e0 0x7f2dbc090d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc011480 tx=0x7f2dcc0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:47.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.273+0000 7f2dc4ff9700 1 -- 172.21.15.115:0/3782644551 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2dc0087120 con 0x7f2dd009de30 2023-09-29T23:07:47.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.473+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/3782644551 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2dd0070990 con 0x7f2dd009de30 2023-09-29T23:07:47.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.473+0000 7f2dc4ff9700 1 -- 172.21.15.115:0/3782644551 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2dc008a740 con 0x7f2dd009de30 2023-09-29T23:07:47.479 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:47.479 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:47.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.481+0000 7f2dd6f4b700 10 mgrc shutdown 2023-09-29T23:07:47.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.481+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/3782644551 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2dbc08e8e0 msgr2=0x7f2dbc090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:47.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.481+0000 7f2dd6f4b700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2dbc08e8e0 0x7f2dbc090d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc011480 tx=0x7f2dcc0091a0 comp rx=0 tx=0).stop 2023-09-29T23:07:47.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.481+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/3782644551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dd009de30 msgr2=0x7f2dd006c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:47.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.481+0000 7f2dd6f4b700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dd009de30 0x7f2dd006c7c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009290 tx=0x7f2dc0016000 comp rx=0 tx=0).stop 2023-09-29T23:07:47.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.481+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/3782644551 shutdown_connections 2023-09-29T23:07:47.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.481+0000 7f2dd6f4b700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2dd009e240 0x7f2dd006cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:47.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.481+0000 7f2dd6f4b700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2dd009de30 0x7f2dd006c7c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:47.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.481+0000 7f2dd6f4b700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2dbc08e8e0 0x7f2dbc090d90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:47.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.481+0000 7f2dd6f4b700 1 --2- 172.21.15.115:0/3782644551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd009b190 0x7f2dd0143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:47.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.481+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/3782644551 >> 172.21.15.115:0/3782644551 conn(0x7f2dd00695c0 msgr2=0x7f2dd009f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:47.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.481+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/3782644551 shutdown_connections 2023-09-29T23:07:47.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:47.481+0000 7f2dd6f4b700 1 -- 172.21.15.115:0/3782644551 wait complete. 2023-09-29T23:07:50.497 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:50.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d2380700 1 Processor -- start 2023-09-29T23:07:50.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d2380700 1 -- start start 2023-09-29T23:07:50.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d2380700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f60cc09d9e0 0x7f60cc140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:50.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d2380700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f60cc09ddb0 0x7f60cc09f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:50.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d2380700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc13e770 con 0x7f60cc13d700 2023-09-29T23:07:50.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d2380700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc141d20 con 0x7f60cc09ddb0 2023-09-29T23:07:50.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d2380700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc13dc00 con 0x7f60cc09d9e0 2023-09-29T23:07:50.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d0b7d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f60cc09ddb0 0x7f60cc09f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:50.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d1b7f700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f60cc13d700 0x7f60cc141610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58906/0 (socket says 172.21.15.115:58906) 2023-09-29T23:07:50.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d1b7f700 1 -- 172.21.15.115:0/1153749569 learned_addr learned my addr 172.21.15.115:0/1153749569 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:07:50.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d137e700 1 --2- 172.21.15.115:0/1153749569 >> v2:172.21.15.156:3300/0 conn(0x7f60cc09d9e0 0x7f60cc140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:50.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d0b7d700 1 -- 172.21.15.115:0/1153749569 >> v2:172.21.15.156:3300/0 conn(0x7f60cc09d9e0 msgr2=0x7f60cc140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:50.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d0b7d700 1 --2- 172.21.15.115:0/1153749569 >> v2:172.21.15.156:3300/0 conn(0x7f60cc09d9e0 0x7f60cc140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:50.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d0b7d700 1 -- 172.21.15.115:0/1153749569 >> v1:172.21.15.115:6789/0 conn(0x7f60cc13d700 legacy=0x7f60cc141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:50.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d0b7d700 1 -- 172.21.15.115:0/1153749569 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc13dec0 con 0x7f60cc09ddb0 2023-09-29T23:07:50.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60d0b7d700 1 --2- 172.21.15.115:0/1153749569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc09ddb0 0x7f60cc09f640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06b300 tx=0x7f60c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293049099d55a6cb server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:50.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60c3fff700 1 -- 172.21.15.115:0/1153749569 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c800b690 con 0x7f60cc09ddb0 2023-09-29T23:07:50.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60c3fff700 1 -- 172.21.15.115:0/1153749569 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c800b7f0 con 0x7f60cc09ddb0 2023-09-29T23:07:50.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.609+0000 7f60c3fff700 1 -- 172.21.15.115:0/1153749569 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c800bb90 con 0x7f60cc09ddb0 2023-09-29T23:07:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.613+0000 7f60d2380700 1 -- 172.21.15.115:0/1153749569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc09ddb0 msgr2=0x7f60cc09f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.613+0000 7f60d2380700 1 --2- 172.21.15.115:0/1153749569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc09ddb0 0x7f60cc09f640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06b300 tx=0x7f60c80091a0 comp rx=0 tx=0).stop 2023-09-29T23:07:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.613+0000 7f60d2380700 1 -- 172.21.15.115:0/1153749569 shutdown_connections 2023-09-29T23:07:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.613+0000 7f60d2380700 1 --2- 172.21.15.115:0/1153749569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc09ddb0 0x7f60cc09f640 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.613+0000 7f60d2380700 1 --2- 172.21.15.115:0/1153749569 >> v2:172.21.15.156:3300/0 conn(0x7f60cc09d9e0 0x7f60cc140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.613+0000 7f60d2380700 1 -- 172.21.15.115:0/1153749569 >> 172.21.15.115:0/1153749569 conn(0x7f60cc0b1d20 msgr2=0x7f60cc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.613+0000 7f60d2380700 1 -- 172.21.15.115:0/1153749569 shutdown_connections 2023-09-29T23:07:50.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.613+0000 7f60d2380700 1 -- 172.21.15.115:0/1153749569 wait complete. 2023-09-29T23:07:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.613+0000 7f60d2380700 1 Processor -- start 2023-09-29T23:07:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.613+0000 7f60d2380700 1 -- start start 2023-09-29T23:07:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d2380700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60cc09d9e0 0x7f60cc13af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d2380700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc09ddb0 0x7f60cc150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d2380700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc13d700 0x7f60cc06e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d2380700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc098600 con 0x7f60cc09ddb0 2023-09-29T23:07:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d2380700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc097fe0 con 0x7f60cc09d9e0 2023-09-29T23:07:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d2380700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc151080 con 0x7f60cc13d700 2023-09-29T23:07:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d0b7d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc09ddb0 0x7f60cc150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d1b7f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc13d700 0x7f60cc06e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:50.621 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d0b7d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc09ddb0 0x7f60cc150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48982/0 (socket says 172.21.15.115:48982) 2023-09-29T23:07:50.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d1b7f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc13d700 0x7f60cc06e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:48772/0 (socket says 172.21.15.115:48772) 2023-09-29T23:07:50.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d0b7d700 1 -- 172.21.15.115:0/1885006877 learned_addr learned my addr 172.21.15.115:0/1885006877 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:50.622 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d137e700 1 --2- 172.21.15.115:0/1885006877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60cc09d9e0 0x7f60cc13af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:50.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d0b7d700 1 -- 172.21.15.115:0/1885006877 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc13d700 msgr2=0x7f60cc06e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:50.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d0b7d700 1 --2- 172.21.15.115:0/1885006877 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc13d700 0x7f60cc06e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:50.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d0b7d700 1 -- 172.21.15.115:0/1885006877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60cc09d9e0 msgr2=0x7f60cc13af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:50.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d0b7d700 1 --2- 172.21.15.115:0/1885006877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60cc09d9e0 0x7f60cc13af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:50.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d0b7d700 1 -- 172.21.15.115:0/1885006877 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c8009420 con 0x7f60cc09ddb0 2023-09-29T23:07:50.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d0b7d700 1 --2- 172.21.15.115:0/1885006877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc09ddb0 0x7f60cc150a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06c1d0 tx=0x7f60c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:50.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60c17fa700 1 -- 172.21.15.115:0/1885006877 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c800bb70 con 0x7f60cc09ddb0 2023-09-29T23:07:50.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60c17fa700 1 -- 172.21.15.115:0/1885006877 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c8011420 con 0x7f60cc09ddb0 2023-09-29T23:07:50.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d2380700 1 -- 172.21.15.115:0/1885006877 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc151340 con 0x7f60cc09ddb0 2023-09-29T23:07:50.625 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60c17fa700 1 -- 172.21.15.115:0/1885006877 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c80117c0 con 0x7f60cc09ddb0 2023-09-29T23:07:50.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.617+0000 7f60d2380700 1 -- 172.21.15.115:0/1885006877 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc0b1520 con 0x7f60cc09ddb0 2023-09-29T23:07:50.626 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.621+0000 7f60d2380700 1 -- 172.21.15.115:0/1885006877 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc0987b0 con 0x7f60cc09ddb0 2023-09-29T23:07:50.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.621+0000 7f60c17fa700 1 -- 172.21.15.115:0/1885006877 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f60c8011bb0 con 0x7f60cc09ddb0 2023-09-29T23:07:50.627 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.621+0000 7f60c17fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:50.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.621+0000 7f60c17fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:50.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.621+0000 7f60c17fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:50.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.621+0000 7f60c17fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:50.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.621+0000 7f60c17fa700 1 --2- 172.21.15.115:0/1885006877 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f60b008e830 0x7f60b0090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:50.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.621+0000 7f60c17fa700 1 -- 172.21.15.115:0/1885006877 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f60c80b6810 con 0x7f60cc09ddb0 2023-09-29T23:07:50.628 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.621+0000 7f60d137e700 1 --2- 172.21.15.115:0/1885006877 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f60b008e830 0x7f60b0090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:50.629 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.625+0000 7f60d137e700 1 --2- 172.21.15.115:0/1885006877 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f60b008e830 0x7f60b0090ce0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009db0 tx=0x7f60bc0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:50.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.629+0000 7f60c17fa700 1 -- 172.21.15.115:0/1885006877 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f60c8087240 con 0x7f60cc09ddb0 2023-09-29T23:07:50.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 1 -- 172.21.15.115:0/1885006877 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f60cc04be00 con 0x7f60cc09ddb0 2023-09-29T23:07:50.823 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60c17fa700 1 -- 172.21.15.115:0/1885006877 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f60c8011e60 con 0x7f60cc09ddb0 2023-09-29T23:07:50.823 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:50.823 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:50.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 10 mgrc shutdown 2023-09-29T23:07:50.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 1 -- 172.21.15.115:0/1885006877 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f60b008e830 msgr2=0x7f60b0090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:50.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 1 --2- 172.21.15.115:0/1885006877 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f60b008e830 0x7f60b0090ce0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009db0 tx=0x7f60bc0091a0 comp rx=0 tx=0).stop 2023-09-29T23:07:50.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 1 -- 172.21.15.115:0/1885006877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc09ddb0 msgr2=0x7f60cc150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:50.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 1 --2- 172.21.15.115:0/1885006877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc09ddb0 0x7f60cc150a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f60cc06c1d0 tx=0x7f60c8017000 comp rx=0 tx=0).stop 2023-09-29T23:07:50.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 1 -- 172.21.15.115:0/1885006877 shutdown_connections 2023-09-29T23:07:50.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 1 --2- 172.21.15.115:0/1885006877 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60cc13d700 0x7f60cc06e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:50.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 1 --2- 172.21.15.115:0/1885006877 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f60b008e830 0x7f60b0090ce0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:50.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 1 --2- 172.21.15.115:0/1885006877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60cc09ddb0 0x7f60cc150a50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:50.826 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 1 --2- 172.21.15.115:0/1885006877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60cc09d9e0 0x7f60cc13af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:50.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 1 -- 172.21.15.115:0/1885006877 >> 172.21.15.115:0/1885006877 conn(0x7f60cc0b1d20 msgr2=0x7f60cc0670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:50.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 1 -- 172.21.15.115:0/1885006877 shutdown_connections 2023-09-29T23:07:50.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:50.821+0000 7f60d2380700 1 -- 172.21.15.115:0/1885006877 wait complete. 2023-09-29T23:07:53.838 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:53.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.945+0000 7f1196946700 1 Processor -- start 2023-09-29T23:07:53.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.945+0000 7f1196946700 1 -- start start 2023-09-29T23:07:53.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1196946700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f11900682e0 0x7f11900a4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:53.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1196946700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f11900a28c0 0x7f119014a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:53.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1196946700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11900a45a0 con 0x7f1190143080 2023-09-29T23:07:53.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1196946700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11900686b0 con 0x7f11900682e0 2023-09-29T23:07:53.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1196946700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1190143650 con 0x7f11900a28c0 2023-09-29T23:07:53.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f11877fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1190143080 0x7f119009e0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:58922/0 (socket says 172.21.15.115:58922) 2023-09-29T23:07:53.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f11877fe700 1 -- 172.21.15.115:0/2997055681 learned_addr learned my addr 172.21.15.115:0/2997055681 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:07:53.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f118ffff700 1 --2- 172.21.15.115:0/2997055681 >> v2:172.21.15.115:3300/0 conn(0x7f11900682e0 0x7f11900a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:53.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1194ee3700 1 --2- 172.21.15.115:0/2997055681 >> v2:172.21.15.156:3300/0 conn(0x7f11900a28c0 0x7f119014a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:53.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f118f7fe700 1 -- 172.21.15.115:0/2997055681 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275640542 0 0) 0x7f1178001110 con 0x7f1190143080 2023-09-29T23:07:53.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f118f7fe700 1 -- 172.21.15.115:0/2997055681 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f117c003570 con 0x7f1190143080 2023-09-29T23:07:53.952 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f118ffff700 1 -- 172.21.15.115:0/2997055681 >> v2:172.21.15.156:3300/0 conn(0x7f11900a28c0 msgr2=0x7f119014a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:53.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f118ffff700 1 --2- 172.21.15.115:0/2997055681 >> v2:172.21.15.156:3300/0 conn(0x7f11900a28c0 0x7f119014a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:53.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f118ffff700 1 -- 172.21.15.115:0/2997055681 >> v1:172.21.15.115:6789/0 conn(0x7f1190143080 legacy=0x7f119009e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:53.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f118f7fe700 1 -- 172.21.15.115:0/2997055681 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4175885375 0 0) 0x7f117c003570 con 0x7f1190143080 2023-09-29T23:07:53.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f118ffff700 1 -- 172.21.15.115:0/2997055681 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1190143910 con 0x7f11900682e0 2023-09-29T23:07:53.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f118ffff700 1 --2- 172.21.15.115:0/2997055681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11900682e0 0x7f11900a4060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f119006b2b0 tx=0x7f11800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60095f920e9f00f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:53.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f118f7fe700 1 -- 172.21.15.115:0/2997055681 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1178001600 con 0x7f11900682e0 2023-09-29T23:07:53.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f118f7fe700 1 -- 172.21.15.115:0/2997055681 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1180011420 con 0x7f11900682e0 2023-09-29T23:07:53.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f118f7fe700 1 -- 172.21.15.115:0/2997055681 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800117c0 con 0x7f11900682e0 2023-09-29T23:07:53.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1196946700 1 -- 172.21.15.115:0/2997055681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11900682e0 msgr2=0x7f11900a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:53.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1196946700 1 --2- 172.21.15.115:0/2997055681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11900682e0 0x7f11900a4060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f119006b2b0 tx=0x7f11800091a0 comp rx=0 tx=0).stop 2023-09-29T23:07:53.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1196946700 1 -- 172.21.15.115:0/2997055681 shutdown_connections 2023-09-29T23:07:53.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1196946700 1 --2- 172.21.15.115:0/2997055681 >> v2:172.21.15.156:3300/0 conn(0x7f11900a28c0 0x7f119014a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:53.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1196946700 1 --2- 172.21.15.115:0/2997055681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11900682e0 0x7f11900a4060 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:53.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1196946700 1 -- 172.21.15.115:0/2997055681 >> 172.21.15.115:0/2997055681 conn(0x7f11900695c0 msgr2=0x7f11900699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:53.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1196946700 1 -- 172.21.15.115:0/2997055681 shutdown_connections 2023-09-29T23:07:53.954 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.949+0000 7f1196946700 1 -- 172.21.15.115:0/2997055681 wait complete. 2023-09-29T23:07:53.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f1196946700 1 Processor -- start 2023-09-29T23:07:53.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f1196946700 1 -- start start 2023-09-29T23:07:53.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f1196946700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11900682e0 0x7f119006f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:53.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f1196946700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11900a28c0 0x7f119006dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:53.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f1196946700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1190143080 0x7f119006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:53.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f1196946700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119006d9f0 con 0x7f11900a28c0 2023-09-29T23:07:53.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f1196946700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119006d470 con 0x7f1190143080 2023-09-29T23:07:53.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f1196946700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119006d730 con 0x7f11900682e0 2023-09-29T23:07:53.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f118ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11900682e0 0x7f119006f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:53.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f11877fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11900a28c0 0x7f119006dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:53.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f118ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11900682e0 0x7f119006f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:48776/0 (socket says 172.21.15.115:48776) 2023-09-29T23:07:53.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f118ffff700 1 -- 172.21.15.115:0/454501509 learned_addr learned my addr 172.21.15.115:0/454501509 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:53.957 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f1194ee3700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1190143080 0x7f119006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:53.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f11877fe700 1 -- 172.21.15.115:0/454501509 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11900682e0 msgr2=0x7f119006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:53.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f11877fe700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11900682e0 0x7f119006f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:53.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f11877fe700 1 -- 172.21.15.115:0/454501509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1190143080 msgr2=0x7f119006caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:53.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f11877fe700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1190143080 0x7f119006caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:53.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f11877fe700 1 -- 172.21.15.115:0/454501509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1180009420 con 0x7f11900a28c0 2023-09-29T23:07:53.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f118ffff700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11900682e0 0x7f119006f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:07:53.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f11877fe700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11900a28c0 0x7f119006dba0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f117800c7f0 tx=0x7f1178001dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:53.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f118cff9700 1 -- 172.21.15.115:0/454501509 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1178007360 con 0x7f11900a28c0 2023-09-29T23:07:53.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f118cff9700 1 -- 172.21.15.115:0/454501509 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11780074e0 con 0x7f11900a28c0 2023-09-29T23:07:53.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f1196946700 1 -- 172.21.15.115:0/454501509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119006e720 con 0x7f11900a28c0 2023-09-29T23:07:53.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.953+0000 7f118cff9700 1 -- 172.21.15.115:0/454501509 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1178004830 con 0x7f11900a28c0 2023-09-29T23:07:53.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.957+0000 7f1196946700 1 -- 172.21.15.115:0/454501509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11900a1030 con 0x7f11900a28c0 2023-09-29T23:07:53.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.957+0000 7f1196946700 1 -- 172.21.15.115:0/454501509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1190070990 con 0x7f11900a28c0 2023-09-29T23:07:53.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.961+0000 7f118cff9700 1 -- 172.21.15.115:0/454501509 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f1178004be0 con 0x7f11900a28c0 2023-09-29T23:07:53.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.961+0000 7f118cff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:53.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.961+0000 7f118cff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:53.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.961+0000 7f118cff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:53.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.961+0000 7f118cff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:53.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.961+0000 7f118cff9700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f117008e980 0x7f1170090e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:53.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.961+0000 7f118cff9700 1 -- 172.21.15.115:0/454501509 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f11780b4110 con 0x7f11900a28c0 2023-09-29T23:07:53.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.961+0000 7f118ffff700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f117008e980 0x7f1170090e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:53.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.961+0000 7f118ffff700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f117008e980 0x7f1170090e30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f11800093a0 tx=0x7f1180016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:53.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:53.965+0000 7f118cff9700 1 -- 172.21.15.115:0/454501509 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1178084b20 con 0x7f11900a28c0 2023-09-29T23:07:54.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 1 -- 172.21.15.115:0/454501509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f11900a45a0 con 0x7f11900a28c0 2023-09-29T23:07:54.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f118cff9700 1 -- 172.21.15.115:0/454501509 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f11900a45a0 con 0x7f11900a28c0 2023-09-29T23:07:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:54.159 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:54.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 10 mgrc shutdown 2023-09-29T23:07:54.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 1 -- 172.21.15.115:0/454501509 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f117008e980 msgr2=0x7f1170090e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:54.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f117008e980 0x7f1170090e30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f11800093a0 tx=0x7f1180016000 comp rx=0 tx=0).stop 2023-09-29T23:07:54.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 1 -- 172.21.15.115:0/454501509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11900a28c0 msgr2=0x7f119006dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:54.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11900a28c0 0x7f119006dba0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f117800c7f0 tx=0x7f1178001dd0 comp rx=0 tx=0).stop 2023-09-29T23:07:54.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 1 -- 172.21.15.115:0/454501509 shutdown_connections 2023-09-29T23:07:54.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1190143080 0x7f119006caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:54.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f117008e980 0x7f1170090e30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:54.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11900a28c0 0x7f119006dba0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:54.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 1 --2- 172.21.15.115:0/454501509 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f11900682e0 0x7f119006f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:54.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 1 -- 172.21.15.115:0/454501509 >> 172.21.15.115:0/454501509 conn(0x7f11900695c0 msgr2=0x7f11900677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:54.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 1 -- 172.21.15.115:0/454501509 shutdown_connections 2023-09-29T23:07:54.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:54.157+0000 7f1196946700 1 -- 172.21.15.115:0/454501509 wait complete. 2023-09-29T23:07:57.174 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:07:57.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.281+0000 7ff00ad8d700 1 Processor -- start 2023-09-29T23:07:57.285 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.281+0000 7ff00ad8d700 1 -- start start 2023-09-29T23:07:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.281+0000 7ff00ad8d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff00409d9e0 0x7ff004140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.281+0000 7ff00ad8d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff00413d700 0x7ff00409f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:57.286 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.281+0000 7ff00ad8d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00413e770 con 0x7ff00409ddb0 2023-09-29T23:07:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.281+0000 7ff00ad8d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff004141d20 con 0x7ff00413d700 2023-09-29T23:07:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00ad8d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00413dc00 con 0x7ff00409d9e0 2023-09-29T23:07:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00a58c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff00413d700 0x7ff00409f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00958a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff00409ddb0 0x7ff004141610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44314/0 (socket says 172.21.15.115:44314) 2023-09-29T23:07:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00958a700 1 -- 172.21.15.115:0/766942839 learned_addr learned my addr 172.21.15.115:0/766942839 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:07:57.287 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff009d8b700 1 --2- 172.21.15.115:0/766942839 >> v2:172.21.15.156:3300/0 conn(0x7ff00409d9e0 0x7ff004140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:57.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00a58c700 1 -- 172.21.15.115:0/766942839 >> v2:172.21.15.156:3300/0 conn(0x7ff00409d9e0 msgr2=0x7ff004140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:07:57.288 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00a58c700 1 --2- 172.21.15.115:0/766942839 >> v2:172.21.15.156:3300/0 conn(0x7ff00409d9e0 0x7ff004140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:57.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00a58c700 1 -- 172.21.15.115:0/766942839 >> v1:172.21.15.115:6789/0 conn(0x7ff00409ddb0 legacy=0x7ff004141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:57.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00a58c700 1 -- 172.21.15.115:0/766942839 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00413dec0 con 0x7ff00413d700 2023-09-29T23:07:57.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00a58c700 1 --2- 172.21.15.115:0/766942839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff00413d700 0x7ff00409f640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff00406b300 tx=0x7ff0000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1abde8eeead77c server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:57.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff008d89700 1 -- 172.21.15.115:0/766942839 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000b690 con 0x7ff00413d700 2023-09-29T23:07:57.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff008d89700 1 -- 172.21.15.115:0/766942839 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00000b7f0 con 0x7ff00413d700 2023-09-29T23:07:57.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff008d89700 1 -- 172.21.15.115:0/766942839 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000bb90 con 0x7ff00413d700 2023-09-29T23:07:57.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00ad8d700 1 -- 172.21.15.115:0/766942839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff00413d700 msgr2=0x7ff00409f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:57.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00ad8d700 1 --2- 172.21.15.115:0/766942839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff00413d700 0x7ff00409f640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff00406b300 tx=0x7ff0000091a0 comp rx=0 tx=0).stop 2023-09-29T23:07:57.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00ad8d700 1 -- 172.21.15.115:0/766942839 shutdown_connections 2023-09-29T23:07:57.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00ad8d700 1 --2- 172.21.15.115:0/766942839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff00413d700 0x7ff00409f640 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:57.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00ad8d700 1 --2- 172.21.15.115:0/766942839 >> v2:172.21.15.156:3300/0 conn(0x7ff00409d9e0 0x7ff004140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:57.289 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00ad8d700 1 -- 172.21.15.115:0/766942839 >> 172.21.15.115:0/766942839 conn(0x7ff0040b1d20 msgr2=0x7ff0040b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:57.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00ad8d700 1 -- 172.21.15.115:0/766942839 shutdown_connections 2023-09-29T23:07:57.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.285+0000 7ff00ad8d700 1 -- 172.21.15.115:0/766942839 wait complete. 2023-09-29T23:07:57.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00ad8d700 1 Processor -- start 2023-09-29T23:07:57.291 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00ad8d700 1 -- start start 2023-09-29T23:07:57.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00ad8d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff00409d9e0 0x7ff00406f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:57.292 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00ad8d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff00409ddb0 0x7ff00409d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:57.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00ad8d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff00413d700 0x7ff00414f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:57.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00ad8d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00406ed00 con 0x7ff00409d9e0 2023-09-29T23:07:57.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00ad8d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00409c820 con 0x7ff00409ddb0 2023-09-29T23:07:57.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00ad8d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00406dd40 con 0x7ff00413d700 2023-09-29T23:07:57.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff009d8b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff00409d9e0 0x7ff00406f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:57.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00a58c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff00413d700 0x7ff00414f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:57.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00a58c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff00413d700 0x7ff00414f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:41432/0 (socket says 172.21.15.115:41432) 2023-09-29T23:07:57.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff009d8b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff00409d9e0 0x7ff00406f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52638/0 (socket says 172.21.15.115:52638) 2023-09-29T23:07:57.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00a58c700 1 -- 172.21.15.115:0/508815597 learned_addr learned my addr 172.21.15.115:0/508815597 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:07:57.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00958a700 1 --2- 172.21.15.115:0/508815597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff00409ddb0 0x7ff00409d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:57.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00a58c700 1 -- 172.21.15.115:0/508815597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff00409ddb0 msgr2=0x7ff00409d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:57.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00a58c700 1 --2- 172.21.15.115:0/508815597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff00409ddb0 0x7ff00409d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:57.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00a58c700 1 -- 172.21.15.115:0/508815597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff00409d9e0 msgr2=0x7ff00406f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:57.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00a58c700 1 --2- 172.21.15.115:0/508815597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff00409d9e0 0x7ff00406f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:57.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00a58c700 1 -- 172.21.15.115:0/508815597 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff000009420 con 0x7ff00413d700 2023-09-29T23:07:57.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00a58c700 1 --2- 172.21.15.115:0/508815597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff00413d700 0x7ff00414f8e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff00406c1d0 tx=0x7ff000017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:57.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7feff9ffb700 1 -- 172.21.15.115:0/508815597 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000011420 con 0x7ff00413d700 2023-09-29T23:07:57.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7feff9ffb700 1 -- 172.21.15.115:0/508815597 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0000115a0 con 0x7ff00413d700 2023-09-29T23:07:57.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7feff9ffb700 1 -- 172.21.15.115:0/508815597 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000011960 con 0x7ff00413d700 2023-09-29T23:07:57.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00ad8d700 1 -- 172.21.15.115:0/508815597 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00414f620 con 0x7ff00413d700 2023-09-29T23:07:57.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.289+0000 7ff00ad8d700 1 -- 172.21.15.115:0/508815597 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0040af660 con 0x7ff00413d700 2023-09-29T23:07:57.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.293+0000 7ff00ad8d700 1 -- 172.21.15.115:0/508815597 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00404be00 con 0x7ff00413d700 2023-09-29T23:07:57.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.293+0000 7feff9ffb700 1 -- 172.21.15.115:0/508815597 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7ff000011d50 con 0x7ff00413d700 2023-09-29T23:07:57.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.293+0000 7feff9ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:07:57.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.293+0000 7feff9ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:07:57.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.293+0000 7feff9ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:57.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.293+0000 7feff9ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:07:57.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.293+0000 7feff9ffb700 1 --2- 172.21.15.115:0/508815597 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fefe808e8b0 0x7fefe8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:07:57.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.293+0000 7feff9ffb700 1 -- 172.21.15.115:0/508815597 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7ff0000b6290 con 0x7ff00413d700 2023-09-29T23:07:57.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.293+0000 7ff009d8b700 1 --2- 172.21.15.115:0/508815597 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fefe808e8b0 0x7fefe8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:07:57.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.297+0000 7ff009d8b700 1 --2- 172.21.15.115:0/508815597 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fefe808e8b0 0x7fefe8090d60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feffc00f570 tx=0x7feffc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:07:57.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.305+0000 7feff9ffb700 1 -- 172.21.15.115:0/508815597 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff000086cc0 con 0x7ff00413d700 2023-09-29T23:07:57.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.497+0000 7ff00ad8d700 1 -- 172.21.15.115:0/508815597 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff00406deb0 con 0x7ff00413d700 2023-09-29T23:07:57.502 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7feff9ffb700 1 -- 172.21.15.115:0/508815597 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff000015100 con 0x7ff00413d700 2023-09-29T23:07:57.503 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:07:57.503 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:07:57.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7ff00ad8d700 10 mgrc shutdown 2023-09-29T23:07:57.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7ff00ad8d700 1 -- 172.21.15.115:0/508815597 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fefe808e8b0 msgr2=0x7fefe8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:57.505 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7ff00ad8d700 1 --2- 172.21.15.115:0/508815597 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fefe808e8b0 0x7fefe8090d60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feffc00f570 tx=0x7feffc00b040 comp rx=0 tx=0).stop 2023-09-29T23:07:57.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7ff00ad8d700 1 -- 172.21.15.115:0/508815597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff00413d700 msgr2=0x7ff00414f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:07:57.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7ff00ad8d700 1 --2- 172.21.15.115:0/508815597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff00413d700 0x7ff00414f8e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff00406c1d0 tx=0x7ff000017000 comp rx=0 tx=0).stop 2023-09-29T23:07:57.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7ff00ad8d700 1 -- 172.21.15.115:0/508815597 shutdown_connections 2023-09-29T23:07:57.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7ff00ad8d700 1 --2- 172.21.15.115:0/508815597 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff00413d700 0x7ff00414f8e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:57.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7ff00ad8d700 1 --2- 172.21.15.115:0/508815597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff00409ddb0 0x7ff00409d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:57.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7ff00ad8d700 1 --2- 172.21.15.115:0/508815597 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fefe808e8b0 0x7fefe8090d60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:57.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7ff00ad8d700 1 --2- 172.21.15.115:0/508815597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff00409d9e0 0x7ff00406f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:07:57.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7ff00ad8d700 1 -- 172.21.15.115:0/508815597 >> 172.21.15.115:0/508815597 conn(0x7ff0040b1d20 msgr2=0x7ff00409ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:07:57.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7ff00ad8d700 1 -- 172.21.15.115:0/508815597 shutdown_connections 2023-09-29T23:07:57.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:07:57.501+0000 7ff00ad8d700 1 -- 172.21.15.115:0/508815597 wait complete. 2023-09-29T23:08:00.518 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:00.630 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47d038700 1 Processor -- start 2023-09-29T23:08:00.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47d038700 1 -- start start 2023-09-29T23:08:00.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47d038700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff478067b60 0x7ff47809cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:00.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47d038700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47809d180 con 0x7ff478133920 2023-09-29T23:08:00.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47d038700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478067f30 con 0x7ff478140e30 2023-09-29T23:08:00.631 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47d038700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff478141d20 con 0x7ff478067b60 2023-09-29T23:08:00.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff477fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff478067b60 0x7ff47809cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:00.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47c837700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff478133920 0x7ff478148170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44322/0 (socket says 172.21.15.115:44322) 2023-09-29T23:08:00.632 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47c837700 1 -- 172.21.15.115:0/1244344431 learned_addr learned my addr 172.21.15.115:0/1244344431 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:08:00.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff477fff700 1 -- 172.21.15.115:0/1244344431 >> v1:172.21.15.156:6789/0 conn(0x7ff478140e30 legacy=0x7ff478141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:00.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff477fff700 1 -- 172.21.15.115:0/1244344431 >> v1:172.21.15.115:6789/0 conn(0x7ff478133920 legacy=0x7ff478148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:00.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff477fff700 1 -- 172.21.15.115:0/1244344431 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4780a3f80 con 0x7ff478067b60 2023-09-29T23:08:00.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff477fff700 1 --2- 172.21.15.115:0/1244344431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff478067b60 0x7ff47809cc40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff4680098e0 tx=0x7ff4680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d7498f32e1c110 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:00.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff4777fe700 1 -- 172.21.15.115:0/1244344431 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468009e80 con 0x7ff478067b60 2023-09-29T23:08:00.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff4777fe700 1 -- 172.21.15.115:0/1244344431 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46800b860 con 0x7ff478067b60 2023-09-29T23:08:00.633 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff4777fe700 1 -- 172.21.15.115:0/1244344431 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800bbe0 con 0x7ff478067b60 2023-09-29T23:08:00.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47d038700 1 -- 172.21.15.115:0/1244344431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff478067b60 msgr2=0x7ff47809cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:00.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47d038700 1 --2- 172.21.15.115:0/1244344431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff478067b60 0x7ff47809cc40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff4680098e0 tx=0x7ff4680091a0 comp rx=0 tx=0).stop 2023-09-29T23:08:00.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47d038700 1 -- 172.21.15.115:0/1244344431 shutdown_connections 2023-09-29T23:08:00.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47d038700 1 --2- 172.21.15.115:0/1244344431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff478067b60 0x7ff47809cc40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:00.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47d038700 1 -- 172.21.15.115:0/1244344431 >> 172.21.15.115:0/1244344431 conn(0x7ff478068a40 msgr2=0x7ff478068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:00.634 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47d038700 1 -- 172.21.15.115:0/1244344431 shutdown_connections 2023-09-29T23:08:00.635 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.629+0000 7ff47d038700 1 -- 172.21.15.115:0/1244344431 wait complete. 2023-09-29T23:08:00.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff47d038700 1 Processor -- start 2023-09-29T23:08:00.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff47d038700 1 -- start start 2023-09-29T23:08:00.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff47d038700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff478067b60 0x7ff478132cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:00.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff47d038700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff478133920 0x7ff478095dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:00.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff47d038700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff478140e30 0x7ff478150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:00.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff47d038700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff478151bc0 con 0x7ff478140e30 2023-09-29T23:08:00.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff47d038700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff478096a60 con 0x7ff478067b60 2023-09-29T23:08:00.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff47d038700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff478151900 con 0x7ff478133920 2023-09-29T23:08:00.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff47c837700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff478140e30 0x7ff478150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:00.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff477fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff478067b60 0x7ff478132cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:00.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff46f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff478133920 0x7ff478095dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:00.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff47c837700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff478140e30 0x7ff478150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52660/0 (socket says 172.21.15.115:52660) 2023-09-29T23:08:00.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff477fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff478067b60 0x7ff478132cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.115:41126/0 (socket says 172.21.15.115:41126) 2023-09-29T23:08:00.639 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.633+0000 7ff47c837700 1 -- 172.21.15.115:0/3045374572 learned_addr learned my addr 172.21.15.115:0/3045374572 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:00.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.637+0000 7ff46f7fe700 1 -- 172.21.15.115:0/3045374572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff478067b60 msgr2=0x7ff478132cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:00.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.637+0000 7ff46f7fe700 1 --2- 172.21.15.115:0/3045374572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff478067b60 0x7ff478132cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:00.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.637+0000 7ff46f7fe700 1 -- 172.21.15.115:0/3045374572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff478140e30 msgr2=0x7ff478150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:00.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.637+0000 7ff46f7fe700 1 --2- 172.21.15.115:0/3045374572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff478140e30 0x7ff478150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:00.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.637+0000 7ff46f7fe700 1 -- 172.21.15.115:0/3045374572 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468009420 con 0x7ff478133920 2023-09-29T23:08:00.640 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.637+0000 7ff47c837700 1 --2- 172.21.15.115:0/3045374572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff478140e30 0x7ff478150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:08:00.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.637+0000 7ff46f7fe700 1 --2- 172.21.15.115:0/3045374572 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff478133920 0x7ff478095dd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff46000c4c0 tx=0x7ff460007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:00.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.637+0000 7ff474ff9700 1 -- 172.21.15.115:0/3045374572 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46000ce30 con 0x7ff478133920 2023-09-29T23:08:00.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.637+0000 7ff474ff9700 1 -- 172.21.15.115:0/3045374572 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff460011590 con 0x7ff478133920 2023-09-29T23:08:00.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.637+0000 7ff47d038700 1 -- 172.21.15.115:0/3045374572 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47814e820 con 0x7ff478133920 2023-09-29T23:08:00.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.637+0000 7ff474ff9700 1 -- 172.21.15.115:0/3045374572 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff460011950 con 0x7ff478133920 2023-09-29T23:08:00.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.637+0000 7ff47d038700 1 -- 172.21.15.115:0/3045374572 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4780a2970 con 0x7ff478133920 2023-09-29T23:08:00.641 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.637+0000 7ff47d038700 1 -- 172.21.15.115:0/3045374572 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47804be00 con 0x7ff478133920 2023-09-29T23:08:00.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.641+0000 7ff474ff9700 1 -- 172.21.15.115:0/3045374572 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7ff460011d00 con 0x7ff478133920 2023-09-29T23:08:00.642 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.641+0000 7ff474ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:00.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.641+0000 7ff474ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:00.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.641+0000 7ff474ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:00.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.641+0000 7ff474ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:00.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.641+0000 7ff474ff9700 1 --2- 172.21.15.115:0/3045374572 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff45808e8b0 0x7ff458090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:00.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.641+0000 7ff474ff9700 1 -- 172.21.15.115:0/3045374572 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7ff4600b3fb0 con 0x7ff478133920 2023-09-29T23:08:00.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.641+0000 7ff477fff700 1 --2- 172.21.15.115:0/3045374572 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff45808e8b0 0x7ff458090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:00.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.641+0000 7ff477fff700 1 --2- 172.21.15.115:0/3045374572 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff45808e8b0 0x7ff458090d60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff4680093f0 tx=0x7ff468017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:00.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.649+0000 7ff474ff9700 1 -- 172.21.15.115:0/3045374572 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff460084940 con 0x7ff478133920 2023-09-29T23:08:00.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.841+0000 7ff47d038700 1 -- 172.21.15.115:0/3045374572 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff4780a4240 con 0x7ff478133920 2023-09-29T23:08:00.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.841+0000 7ff474ff9700 1 -- 172.21.15.115:0/3045374572 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff460017080 con 0x7ff478133920 2023-09-29T23:08:00.845 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:00.846 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.845+0000 7ff47d038700 10 mgrc shutdown 2023-09-29T23:08:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.845+0000 7ff47d038700 1 -- 172.21.15.115:0/3045374572 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff45808e8b0 msgr2=0x7ff458090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.845+0000 7ff47d038700 1 --2- 172.21.15.115:0/3045374572 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff45808e8b0 0x7ff458090d60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff4680093f0 tx=0x7ff468017000 comp rx=0 tx=0).stop 2023-09-29T23:08:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.845+0000 7ff47d038700 1 -- 172.21.15.115:0/3045374572 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff478133920 msgr2=0x7ff478095dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.845+0000 7ff47d038700 1 --2- 172.21.15.115:0/3045374572 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff478133920 0x7ff478095dd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff46000c4c0 tx=0x7ff460007ec0 comp rx=0 tx=0).stop 2023-09-29T23:08:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.845+0000 7ff47d038700 1 -- 172.21.15.115:0/3045374572 shutdown_connections 2023-09-29T23:08:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.845+0000 7ff47d038700 1 --2- 172.21.15.115:0/3045374572 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff45808e8b0 0x7ff458090d60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.845+0000 7ff47d038700 1 --2- 172.21.15.115:0/3045374572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff478140e30 0x7ff478150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.845+0000 7ff47d038700 1 --2- 172.21.15.115:0/3045374572 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff478133920 0x7ff478095dd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:00.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.845+0000 7ff47d038700 1 --2- 172.21.15.115:0/3045374572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff478067b60 0x7ff478132cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:00.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.845+0000 7ff47d038700 1 -- 172.21.15.115:0/3045374572 >> 172.21.15.115:0/3045374572 conn(0x7ff478068a40 msgr2=0x7ff47813fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:00.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.845+0000 7ff47d038700 1 -- 172.21.15.115:0/3045374572 shutdown_connections 2023-09-29T23:08:00.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:00.845+0000 7ff47d038700 1 -- 172.21.15.115:0/3045374572 wait complete. 2023-09-29T23:08:03.861 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f3003fff700 1 Processor -- start 2023-09-29T23:08:03.973 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f3003fff700 1 -- start start 2023-09-29T23:08:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f3003fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30040a4140 0x7f30040670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f3003fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30040675e0 con 0x7f300409d680 2023-09-29T23:08:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f3003fff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30040a3710 con 0x7f3004068130 2023-09-29T23:08:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f3003fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f300409bd40 con 0x7f30040a4140 2023-09-29T23:08:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f30027fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f300409d680 0x7f3004067a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:44334/0 (socket says 172.21.15.115:44334) 2023-09-29T23:08:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f30027fc700 1 -- 172.21.15.115:0/2008173091 learned_addr learned my addr 172.21.15.115:0/2008173091 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:08:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f3002ffd700 1 --2- 172.21.15.115:0/2008173091 >> v2:172.21.15.115:3300/0 conn(0x7f30040a4140 0x7f30040670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f3001ffb700 1 -- 172.21.15.115:0/2008173091 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842572569 0 0) 0x7f2ff4001490 con 0x7f300409d680 2023-09-29T23:08:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f3001ffb700 1 -- 172.21.15.115:0/2008173091 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fec003570 con 0x7f300409d680 2023-09-29T23:08:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f3001ffb700 1 -- 172.21.15.115:0/2008173091 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2366129475 0 0) 0x7f2fec003570 con 0x7f300409d680 2023-09-29T23:08:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f3002ffd700 1 -- 172.21.15.115:0/2008173091 >> v1:172.21.15.156:6789/0 conn(0x7f3004068130 legacy=0x7f300414e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f3002ffd700 1 -- 172.21.15.115:0/2008173091 >> v1:172.21.15.115:6789/0 conn(0x7f300409d680 legacy=0x7f3004067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.969+0000 7f3002ffd700 1 -- 172.21.15.115:0/2008173091 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30040a4510 con 0x7f30040a4140 2023-09-29T23:08:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3002ffd700 1 --2- 172.21.15.115:0/2008173091 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30040a4140 0x7f30040670a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80098e0 tx=0x7f2ff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fbaefa5b4e709 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3001ffb700 1 -- 172.21.15.115:0/2008173091 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4001980 con 0x7f30040a4140 2023-09-29T23:08:03.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3001ffb700 1 -- 172.21.15.115:0/2008173091 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff8011420 con 0x7f30040a4140 2023-09-29T23:08:03.976 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3001ffb700 1 -- 172.21.15.115:0/2008173091 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80117c0 con 0x7f30040a4140 2023-09-29T23:08:03.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 -- 172.21.15.115:0/2008173091 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30040a4140 msgr2=0x7f30040670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:03.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 --2- 172.21.15.115:0/2008173091 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30040a4140 0x7f30040670a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80098e0 tx=0x7f2ff80091a0 comp rx=0 tx=0).stop 2023-09-29T23:08:03.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 -- 172.21.15.115:0/2008173091 shutdown_connections 2023-09-29T23:08:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 --2- 172.21.15.115:0/2008173091 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30040a4140 0x7f30040670a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 -- 172.21.15.115:0/2008173091 >> 172.21.15.115:0/2008173091 conn(0x7f30040b1d20 msgr2=0x7f30040b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 -- 172.21.15.115:0/2008173091 shutdown_connections 2023-09-29T23:08:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 -- 172.21.15.115:0/2008173091 wait complete. 2023-09-29T23:08:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 Processor -- start 2023-09-29T23:08:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 -- start start 2023-09-29T23:08:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068130 0x7f300406e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f300409d680 0x7f300406cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30040a4140 0x7f300406d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300406ecf0 con 0x7f3004068130 2023-09-29T23:08:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300406dc00 con 0x7f30040a4140 2023-09-29T23:08:03.978 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3003fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300406eae0 con 0x7f300409d680 2023-09-29T23:08:03.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3002ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068130 0x7f300406e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:03.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3002ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068130 0x7f300406e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52676/0 (socket says 172.21.15.115:52676) 2023-09-29T23:08:03.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3002ffd700 1 -- 172.21.15.115:0/567502822 learned_addr learned my addr 172.21.15.115:0/567502822 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:03.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f30027fc700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f300409d680 0x7f300406cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:03.979 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f30037fe700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30040a4140 0x7f300406d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:03.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f30027fc700 1 -- 172.21.15.115:0/567502822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30040a4140 msgr2=0x7f300406d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:03.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f30027fc700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30040a4140 0x7f300406d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:03.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f30027fc700 1 -- 172.21.15.115:0/567502822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068130 msgr2=0x7f300406e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:03.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f30027fc700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068130 0x7f300406e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:03.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f30027fc700 1 -- 172.21.15.115:0/567502822 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff8009420 con 0x7f300409d680 2023-09-29T23:08:03.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f30037fe700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30040a4140 0x7f300406d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:08:03.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.973+0000 7f3002ffd700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068130 0x7f300406e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:08:03.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.977+0000 7f30027fc700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f300409d680 0x7f300406cd40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400cc70 tx=0x7f2ff4001a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:03.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.977+0000 7f2feaffd700 1 -- 172.21.15.115:0/567502822 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4004dc0 con 0x7f300409d680 2023-09-29T23:08:03.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.977+0000 7f3003fff700 1 -- 172.21.15.115:0/567502822 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300409ecf0 con 0x7f300409d680 2023-09-29T23:08:03.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.977+0000 7f2feaffd700 1 -- 172.21.15.115:0/567502822 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff400a690 con 0x7f300409d680 2023-09-29T23:08:03.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.977+0000 7f2feaffd700 1 -- 172.21.15.115:0/567502822 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff400aa50 con 0x7f300409d680 2023-09-29T23:08:03.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.977+0000 7f3003fff700 1 -- 172.21.15.115:0/567502822 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30040a0560 con 0x7f300409d680 2023-09-29T23:08:03.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.977+0000 7f3003fff700 1 -- 172.21.15.115:0/567502822 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300404be00 con 0x7f300409d680 2023-09-29T23:08:03.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.981+0000 7f2feaffd700 1 -- 172.21.15.115:0/567502822 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f2ff4007150 con 0x7f300409d680 2023-09-29T23:08:03.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.981+0000 7f2feaffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:03.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.981+0000 7f2feaffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:03.984 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.981+0000 7f2feaffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:03.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.981+0000 7f2feaffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:03.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.981+0000 7f2feaffd700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2ff008e860 0x7f2ff0090d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:03.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.981+0000 7f2feaffd700 1 -- 172.21.15.115:0/567502822 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f2ff40b4160 con 0x7f300409d680 2023-09-29T23:08:03.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.981+0000 7f3002ffd700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2ff008e860 0x7f2ff0090d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:03.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.981+0000 7f3002ffd700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2ff008e860 0x7f2ff0090d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80093a0 tx=0x7f2ff8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:03.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:03.985+0000 7f2feaffd700 1 -- 172.21.15.115:0/567502822 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2ff4084b00 con 0x7f300409d680 2023-09-29T23:08:04.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.181+0000 7f3003fff700 1 -- 172.21.15.115:0/567502822 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f30040675e0 con 0x7f300409d680 2023-09-29T23:08:04.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.181+0000 7f2feaffd700 1 -- 172.21.15.115:0/567502822 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f30040675e0 con 0x7f300409d680 2023-09-29T23:08:04.183 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:04.183 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:04.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.181+0000 7f3003fff700 10 mgrc shutdown 2023-09-29T23:08:04.186 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.181+0000 7f3003fff700 1 -- 172.21.15.115:0/567502822 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2ff008e860 msgr2=0x7f2ff0090d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:04.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.181+0000 7f3003fff700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2ff008e860 0x7f2ff0090d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80093a0 tx=0x7f2ff8017000 comp rx=0 tx=0).stop 2023-09-29T23:08:04.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.181+0000 7f3003fff700 1 -- 172.21.15.115:0/567502822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f300409d680 msgr2=0x7f300406cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:04.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.181+0000 7f3003fff700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f300409d680 0x7f300406cd40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400cc70 tx=0x7f2ff4001a30 comp rx=0 tx=0).stop 2023-09-29T23:08:04.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.185+0000 7f3003fff700 1 -- 172.21.15.115:0/567502822 shutdown_connections 2023-09-29T23:08:04.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.185+0000 7f3003fff700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30040a4140 0x7f300406d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:04.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.185+0000 7f3003fff700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f300409d680 0x7f300406cd40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:04.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.185+0000 7f3003fff700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2ff008e860 0x7f2ff0090d10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:04.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.185+0000 7f3003fff700 1 --2- 172.21.15.115:0/567502822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004068130 0x7f300406e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:04.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.185+0000 7f3003fff700 1 -- 172.21.15.115:0/567502822 >> 172.21.15.115:0/567502822 conn(0x7f30040b1d20 msgr2=0x7f30040a2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:04.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.185+0000 7f3003fff700 1 -- 172.21.15.115:0/567502822 shutdown_connections 2023-09-29T23:08:04.187 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:04.185+0000 7f3003fff700 1 -- 172.21.15.115:0/567502822 wait complete. 2023-09-29T23:08:07.204 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:07.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 Processor -- start 2023-09-29T23:08:07.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 -- start start 2023-09-29T23:08:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 0x7f64000a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f640013fbd0 0x7f6400146f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64000a5900 con 0x7f640009c190 2023-09-29T23:08:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640009c560 con 0x7f640013fbd0 2023-09-29T23:08:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6400140180 con 0x7f64000a5d60 2023-09-29T23:08:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f63fffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 0x7f64000a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f63fffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 0x7f64000a53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:40268/0 (socket says 172.21.15.115:40268) 2023-09-29T23:08:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f63fffff700 1 -- 172.21.15.115:0/2419560671 learned_addr learned my addr 172.21.15.115:0/2419560671 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405494700 1 --2- 172.21.15.115:0/2419560671 >> v2:172.21.15.115:3300/0 conn(0x7f640013fbd0 0x7f6400146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f63fffff700 1 -- 172.21.15.115:0/2419560671 >> v2:172.21.15.115:3300/0 conn(0x7f640013fbd0 msgr2=0x7f6400146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:07.317 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f63fffff700 1 --2- 172.21.15.115:0/2419560671 >> v2:172.21.15.115:3300/0 conn(0x7f640013fbd0 0x7f6400146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f63fffff700 1 -- 172.21.15.115:0/2419560671 >> v1:172.21.15.156:6789/0 conn(0x7f640009c190 legacy=0x7f640006a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f63fffff700 1 -- 172.21.15.115:0/2419560671 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6400140420 con 0x7f64000a5d60 2023-09-29T23:08:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f63fffff700 1 --2- 172.21.15.115:0/2419560671 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 0x7f64000a53c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009f20 tx=0x7f63f8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd5c1d555fa7113c server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f63ff7fe700 1 -- 172.21.15.115:0/2419560671 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f800e070 con 0x7f64000a5d60 2023-09-29T23:08:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f63ff7fe700 1 -- 172.21.15.115:0/2419560671 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f800ba40 con 0x7f64000a5d60 2023-09-29T23:08:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f63ff7fe700 1 -- 172.21.15.115:0/2419560671 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f80092e0 con 0x7f64000a5d60 2023-09-29T23:08:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 -- 172.21.15.115:0/2419560671 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 msgr2=0x7f64000a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 --2- 172.21.15.115:0/2419560671 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 0x7f64000a53c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009f20 tx=0x7f63f8009840 comp rx=0 tx=0).stop 2023-09-29T23:08:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 -- 172.21.15.115:0/2419560671 shutdown_connections 2023-09-29T23:08:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 --2- 172.21.15.115:0/2419560671 >> v2:172.21.15.115:3300/0 conn(0x7f640013fbd0 0x7f6400146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 --2- 172.21.15.115:0/2419560671 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 0x7f64000a53c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 -- 172.21.15.115:0/2419560671 >> 172.21.15.115:0/2419560671 conn(0x7f6400068a40 msgr2=0x7f6400068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 -- 172.21.15.115:0/2419560671 shutdown_connections 2023-09-29T23:08:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.313+0000 7f6405c95700 1 -- 172.21.15.115:0/2419560671 wait complete. 2023-09-29T23:08:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f6405c95700 1 Processor -- start 2023-09-29T23:08:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f6405c95700 1 -- start start 2023-09-29T23:08:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f6405c95700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f640009c190 0x7f640013bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f6405c95700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 0x7f64000b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:07.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f6405c95700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f640013fbd0 0x7f64000b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:07.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f6405c95700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64000b2c90 con 0x7f640013fbd0 2023-09-29T23:08:07.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f6405c95700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64000b2f50 con 0x7f640009c190 2023-09-29T23:08:07.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f6405c95700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64000a0040 con 0x7f64000a5d60 2023-09-29T23:08:07.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f63fffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 0x7f64000b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:07.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f63fffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 0x7f64000b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:40278/0 (socket says 172.21.15.115:40278) 2023-09-29T23:08:07.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f63fffff700 1 -- 172.21.15.115:0/1820537554 learned_addr learned my addr 172.21.15.115:0/1820537554 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:07.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f6405494700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f640013fbd0 0x7f64000b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:07.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f6404c93700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f640009c190 0x7f640013bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:07.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f63fffff700 1 -- 172.21.15.115:0/1820537554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f640009c190 msgr2=0x7f640013bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:07.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f63fffff700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f640009c190 0x7f640013bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:07.322 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f63fffff700 1 -- 172.21.15.115:0/1820537554 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f640013fbd0 msgr2=0x7f64000b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:07.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f63fffff700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f640013fbd0 0x7f64000b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:07.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f63fffff700 1 -- 172.21.15.115:0/1820537554 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8009ae0 con 0x7f64000a5d60 2023-09-29T23:08:07.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f63fffff700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 0x7f64000b1130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f640009fa40 tx=0x7f63f8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:07.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f63fcff9700 1 -- 172.21.15.115:0/1820537554 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8012850 con 0x7f64000a5d60 2023-09-29T23:08:07.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f63fcff9700 1 -- 172.21.15.115:0/1820537554 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f80129b0 con 0x7f64000a5d60 2023-09-29T23:08:07.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f6405c95700 1 -- 172.21.15.115:0/1820537554 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64000a0200 con 0x7f64000a5d60 2023-09-29T23:08:07.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f63fcff9700 1 -- 172.21.15.115:0/1820537554 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8012d50 con 0x7f64000a5d60 2023-09-29T23:08:07.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.317+0000 7f6405c95700 1 -- 172.21.15.115:0/1820537554 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64000a1d70 con 0x7f64000a5d60 2023-09-29T23:08:07.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.321+0000 7f6405c95700 1 -- 172.21.15.115:0/1820537554 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640009fd40 con 0x7f64000a5d60 2023-09-29T23:08:07.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.321+0000 7f63fcff9700 1 -- 172.21.15.115:0/1820537554 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f63f801d630 con 0x7f64000a5d60 2023-09-29T23:08:07.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.321+0000 7f63fcff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:07.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.321+0000 7f63fcff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:07.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.321+0000 7f63fcff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:07.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.321+0000 7f63fcff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:07.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.321+0000 7f63fcff9700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f63e008e830 0x7f63e0090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:07.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.321+0000 7f63fcff9700 1 -- 172.21.15.115:0/1820537554 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f63f80b5ba0 con 0x7f64000a5d60 2023-09-29T23:08:07.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.321+0000 7f6404c93700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f63e008e830 0x7f63e0090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:07.325 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.321+0000 7f6404c93700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f63e008e830 0x7f63e0090ce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f63f0003a30 tx=0x7f63f0007ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:07.331 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.329+0000 7f63fcff9700 1 -- 172.21.15.115:0/1820537554 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f63f80865d0 con 0x7f64000a5d60 2023-09-29T23:08:07.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.521+0000 7f6405c95700 1 -- 172.21.15.115:0/1820537554 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f64000a5900 con 0x7f64000a5d60 2023-09-29T23:08:07.524 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.521+0000 7f63fcff9700 1 -- 172.21.15.115:0/1820537554 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f64000a5900 con 0x7f64000a5d60 2023-09-29T23:08:07.525 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:07.525 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:07.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.525+0000 7f6405c95700 10 mgrc shutdown 2023-09-29T23:08:07.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.525+0000 7f6405c95700 1 -- 172.21.15.115:0/1820537554 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f63e008e830 msgr2=0x7f63e0090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:07.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.525+0000 7f6405c95700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f63e008e830 0x7f63e0090ce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f63f0003a30 tx=0x7f63f0007ea0 comp rx=0 tx=0).stop 2023-09-29T23:08:07.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.525+0000 7f6405c95700 1 -- 172.21.15.115:0/1820537554 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 msgr2=0x7f64000b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:07.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.525+0000 7f6405c95700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 0x7f64000b1130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f640009fa40 tx=0x7f63f8017000 comp rx=0 tx=0).stop 2023-09-29T23:08:07.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.525+0000 7f6405c95700 1 -- 172.21.15.115:0/1820537554 shutdown_connections 2023-09-29T23:08:07.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.525+0000 7f6405c95700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f63e008e830 0x7f63e0090ce0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:07.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.525+0000 7f6405c95700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f640013fbd0 0x7f64000b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:07.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.525+0000 7f6405c95700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64000a5d60 0x7f64000b1130 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:07.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.525+0000 7f6405c95700 1 --2- 172.21.15.115:0/1820537554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f640009c190 0x7f640013bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:07.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.525+0000 7f6405c95700 1 -- 172.21.15.115:0/1820537554 >> 172.21.15.115:0/1820537554 conn(0x7f6400068a40 msgr2=0x7f640013cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:07.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.525+0000 7f6405c95700 1 -- 172.21.15.115:0/1820537554 shutdown_connections 2023-09-29T23:08:07.529 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:07.525+0000 7f6405c95700 1 -- 172.21.15.115:0/1820537554 wait complete. 2023-09-29T23:08:09.131 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:08:09.134 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:08:10.545 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:10.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c99f9b700 1 Processor -- start 2023-09-29T23:08:10.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c99f9b700 1 -- start start 2023-09-29T23:08:10.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c99f9b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8c9409d9e0 0x7f8c94140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:10.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c99f9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 0x7f8c9409f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:10.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c99f9b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9413e770 con 0x7f8c9413d700 2023-09-29T23:08:10.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c99f9b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c94141d20 con 0x7f8c9409d9e0 2023-09-29T23:08:10.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c99f9b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9413dc00 con 0x7f8c9409ddb0 2023-09-29T23:08:10.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c93fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 0x7f8c9409f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:10.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c93fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 0x7f8c9409f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:40284/0 (socket says 172.21.15.115:40284) 2023-09-29T23:08:10.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c93fff700 1 -- 172.21.15.115:0/3435422247 learned_addr learned my addr 172.21.15.115:0/3435422247 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:10.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c98f99700 1 --2- 172.21.15.115:0/3435422247 >> v2:172.21.15.156:3300/0 conn(0x7f8c9409d9e0 0x7f8c94140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:10.659 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c93fff700 1 -- 172.21.15.115:0/3435422247 >> v2:172.21.15.156:3300/0 conn(0x7f8c9409d9e0 msgr2=0x7f8c94140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:10.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c93fff700 1 --2- 172.21.15.115:0/3435422247 >> v2:172.21.15.156:3300/0 conn(0x7f8c9409d9e0 0x7f8c94140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:10.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c93fff700 1 -- 172.21.15.115:0/3435422247 >> v1:172.21.15.156:6789/0 conn(0x7f8c9413d700 legacy=0x7f8c94141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:10.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c93fff700 1 -- 172.21.15.115:0/3435422247 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9413dec0 con 0x7f8c9409ddb0 2023-09-29T23:08:10.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.653+0000 7f8c98f99700 1 --2- 172.21.15.115:0/3435422247 >> v2:172.21.15.156:3300/0 conn(0x7f8c9409d9e0 0x7f8c94140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:08:10.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c93fff700 1 --2- 172.21.15.115:0/3435422247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 0x7f8c9409f640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8c840099b0 tx=0x7f8c84009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c87a264e74ec9c52 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:10.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c937fe700 1 -- 172.21.15.115:0/3435422247 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400b8b0 con 0x7f8c9409ddb0 2023-09-29T23:08:10.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c937fe700 1 -- 172.21.15.115:0/3435422247 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8400ba10 con 0x7f8c9409ddb0 2023-09-29T23:08:10.660 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c937fe700 1 -- 172.21.15.115:0/3435422247 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400bdb0 con 0x7f8c9409ddb0 2023-09-29T23:08:10.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c99f9b700 1 -- 172.21.15.115:0/3435422247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 msgr2=0x7f8c9409f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:10.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c99f9b700 1 --2- 172.21.15.115:0/3435422247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 0x7f8c9409f640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8c840099b0 tx=0x7f8c84009250 comp rx=0 tx=0).stop 2023-09-29T23:08:10.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c99f9b700 1 -- 172.21.15.115:0/3435422247 shutdown_connections 2023-09-29T23:08:10.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c99f9b700 1 --2- 172.21.15.115:0/3435422247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 0x7f8c9409f640 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:10.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c99f9b700 1 --2- 172.21.15.115:0/3435422247 >> v2:172.21.15.156:3300/0 conn(0x7f8c9409d9e0 0x7f8c94140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:10.661 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c99f9b700 1 -- 172.21.15.115:0/3435422247 >> 172.21.15.115:0/3435422247 conn(0x7f8c940b1d20 msgr2=0x7f8c940b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:10.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c99f9b700 1 -- 172.21.15.115:0/3435422247 shutdown_connections 2023-09-29T23:08:10.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c99f9b700 1 -- 172.21.15.115:0/3435422247 wait complete. 2023-09-29T23:08:10.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c99f9b700 1 Processor -- start 2023-09-29T23:08:10.662 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.657+0000 7f8c99f9b700 1 -- start start 2023-09-29T23:08:10.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c99f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c9409d9e0 0x7f8c9406f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:10.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c99f9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 0x7f8c94099500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c99f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c9413d700 0x7f8c94097840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c99f9b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9414d9e0 con 0x7f8c9409d9e0 2023-09-29T23:08:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c99f9b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9414dca0 con 0x7f8c9413d700 2023-09-29T23:08:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c99f9b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9413d1f0 con 0x7f8c9409ddb0 2023-09-29T23:08:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c98f99700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c9409d9e0 0x7f8c9406f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c93fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 0x7f8c94099500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c98f99700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c9409d9e0 0x7f8c9406f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51338/0 (socket says 172.21.15.115:51338) 2023-09-29T23:08:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c93fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 0x7f8c94099500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:40290/0 (socket says 172.21.15.115:40290) 2023-09-29T23:08:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c98f99700 1 -- 172.21.15.115:0/1188855665 learned_addr learned my addr 172.21.15.115:0/1188855665 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c9979a700 1 --2- 172.21.15.115:0/1188855665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c9413d700 0x7f8c94097840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c93fff700 1 -- 172.21.15.115:0/1188855665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c9413d700 msgr2=0x7f8c94097840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:10.665 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c93fff700 1 --2- 172.21.15.115:0/1188855665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c9413d700 0x7f8c94097840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:10.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c93fff700 1 -- 172.21.15.115:0/1188855665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c9409d9e0 msgr2=0x7f8c9406f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:10.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c93fff700 1 --2- 172.21.15.115:0/1188855665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c9409d9e0 0x7f8c9406f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:10.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c93fff700 1 -- 172.21.15.115:0/1188855665 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c840094f0 con 0x7f8c9409ddb0 2023-09-29T23:08:10.666 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c93fff700 1 --2- 172.21.15.115:0/1188855665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 0x7f8c94099500 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8c940a1a70 tx=0x7f8c84016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c90ff9700 1 -- 172.21.15.115:0/1188855665 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84011cb0 con 0x7f8c9409ddb0 2023-09-29T23:08:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c90ff9700 1 -- 172.21.15.115:0/1188855665 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c84020070 con 0x7f8c9409ddb0 2023-09-29T23:08:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c99f9b700 1 -- 172.21.15.115:0/1188855665 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9414e660 con 0x7f8c9409ddb0 2023-09-29T23:08:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c90ff9700 1 -- 172.21.15.115:0/1188855665 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8401b6a0 con 0x7f8c9409ddb0 2023-09-29T23:08:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.661+0000 7f8c99f9b700 1 -- 172.21.15.115:0/1188855665 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c94099a40 con 0x7f8c9409ddb0 2023-09-29T23:08:10.667 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.665+0000 7f8c99f9b700 1 -- 172.21.15.115:0/1188855665 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c940991e0 con 0x7f8c9409ddb0 2023-09-29T23:08:10.668 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.665+0000 7f8c90ff9700 1 -- 172.21.15.115:0/1188855665 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f8c84022030 con 0x7f8c9409ddb0 2023-09-29T23:08:10.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.665+0000 7f8c90ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:10.669 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.665+0000 7f8c90ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:10.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.665+0000 7f8c90ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:10.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.665+0000 7f8c90ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:10.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.665+0000 7f8c90ff9700 1 --2- 172.21.15.115:0/1188855665 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8c8008e8b0 0x7f8c80090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:10.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.665+0000 7f8c90ff9700 1 -- 172.21.15.115:0/1188855665 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f8c840b6560 con 0x7f8c9409ddb0 2023-09-29T23:08:10.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.665+0000 7f8c98f99700 1 --2- 172.21.15.115:0/1188855665 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8c8008e8b0 0x7f8c80090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:10.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.669+0000 7f8c98f99700 1 --2- 172.21.15.115:0/1188855665 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8c8008e8b0 0x7f8c80090d60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8c88006fd0 tx=0x7f8c88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:10.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.673+0000 7f8c90ff9700 1 -- 172.21.15.115:0/1188855665 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8c84086f90 con 0x7f8c9409ddb0 2023-09-29T23:08:10.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.869+0000 7f8c99f9b700 1 -- 172.21.15.115:0/1188855665 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8c940991e0 con 0x7f8c9409ddb0 2023-09-29T23:08:10.871 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.869+0000 7f8c90ff9700 1 -- 172.21.15.115:0/1188855665 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f8c8408a5b0 con 0x7f8c9409ddb0 2023-09-29T23:08:10.871 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:10.872 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:10.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.873+0000 7f8c99f9b700 10 mgrc shutdown 2023-09-29T23:08:10.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.873+0000 7f8c99f9b700 1 -- 172.21.15.115:0/1188855665 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8c8008e8b0 msgr2=0x7f8c80090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:10.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.873+0000 7f8c99f9b700 1 --2- 172.21.15.115:0/1188855665 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8c8008e8b0 0x7f8c80090d60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8c88006fd0 tx=0x7f8c88008040 comp rx=0 tx=0).stop 2023-09-29T23:08:10.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.873+0000 7f8c99f9b700 1 -- 172.21.15.115:0/1188855665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 msgr2=0x7f8c94099500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:10.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.873+0000 7f8c99f9b700 1 --2- 172.21.15.115:0/1188855665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 0x7f8c94099500 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8c940a1a70 tx=0x7f8c84016000 comp rx=0 tx=0).stop 2023-09-29T23:08:10.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.873+0000 7f8c99f9b700 1 -- 172.21.15.115:0/1188855665 shutdown_connections 2023-09-29T23:08:10.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.873+0000 7f8c99f9b700 1 --2- 172.21.15.115:0/1188855665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c9413d700 0x7f8c94097840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:10.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.873+0000 7f8c99f9b700 1 --2- 172.21.15.115:0/1188855665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c9409ddb0 0x7f8c94099500 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:10.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.873+0000 7f8c99f9b700 1 --2- 172.21.15.115:0/1188855665 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8c8008e8b0 0x7f8c80090d60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:10.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.873+0000 7f8c99f9b700 1 --2- 172.21.15.115:0/1188855665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c9409d9e0 0x7f8c9406f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:10.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.873+0000 7f8c99f9b700 1 -- 172.21.15.115:0/1188855665 >> 172.21.15.115:0/1188855665 conn(0x7f8c940b1d20 msgr2=0x7f8c940afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:10.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.873+0000 7f8c99f9b700 1 -- 172.21.15.115:0/1188855665 shutdown_connections 2023-09-29T23:08:10.876 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:10.873+0000 7f8c99f9b700 1 -- 172.21.15.115:0/1188855665 wait complete. 2023-09-29T23:08:13.892 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:14.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137ffff700 1 Processor -- start 2023-09-29T23:08:14.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137ffff700 1 -- start start 2023-09-29T23:08:14.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f138013d700 0x7f1380140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:14.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137ffff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138013e770 con 0x7f138009ddb0 2023-09-29T23:08:14.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137ffff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138013dc00 con 0x7f138009d9e0 2023-09-29T23:08:14.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137ffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1380141d20 con 0x7f138013d700 2023-09-29T23:08:14.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f138013d700 0x7f1380140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:14.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f138013d700 0x7f1380140d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:40292/0 (socket says 172.21.15.115:40292) 2023-09-29T23:08:14.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137f7fe700 1 -- 172.21.15.115:0/25072191 learned_addr learned my addr 172.21.15.115:0/25072191 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:14.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137f7fe700 1 -- 172.21.15.115:0/25072191 >> v1:172.21.15.156:6789/0 conn(0x7f138009d9e0 legacy=0x7f1380141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:14.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137f7fe700 1 -- 172.21.15.115:0/25072191 >> v1:172.21.15.115:6789/0 conn(0x7f138009ddb0 legacy=0x7f13800a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:14.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137f7fe700 1 -- 172.21.15.115:0/25072191 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138013dec0 con 0x7f138013d700 2023-09-29T23:08:14.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137f7fe700 1 --2- 172.21.15.115:0/25072191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f138013d700 0x7f1380140d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1378009f50 tx=0x7f1378009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86931c972e29de3b server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:14.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.001+0000 7f137dffb700 1 -- 172.21.15.115:0/25072191 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137800e070 con 0x7f138013d700 2023-09-29T23:08:14.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137dffb700 1 -- 172.21.15.115:0/25072191 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137800bb40 con 0x7f138013d700 2023-09-29T23:08:14.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137dffb700 1 -- 172.21.15.115:0/25072191 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780092e0 con 0x7f138013d700 2023-09-29T23:08:14.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 -- 172.21.15.115:0/25072191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f138013d700 msgr2=0x7f1380140d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:14.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 --2- 172.21.15.115:0/25072191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f138013d700 0x7f1380140d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1378009f50 tx=0x7f1378009840 comp rx=0 tx=0).stop 2023-09-29T23:08:14.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 -- 172.21.15.115:0/25072191 shutdown_connections 2023-09-29T23:08:14.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 --2- 172.21.15.115:0/25072191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f138013d700 0x7f1380140d50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:14.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 -- 172.21.15.115:0/25072191 >> 172.21.15.115:0/25072191 conn(0x7f13800b1d20 msgr2=0x7f13800b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:14.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 -- 172.21.15.115:0/25072191 shutdown_connections 2023-09-29T23:08:14.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 -- 172.21.15.115:0/25072191 wait complete. 2023-09-29T23:08:14.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 Processor -- start 2023-09-29T23:08:14.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 -- start start 2023-09-29T23:08:14.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f138009d9e0 0x7f13800b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:14.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f138009ddb0 0x7f138009bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:14.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f138013d700 0x7f13801531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:14.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138009cd00 con 0x7f138009ddb0 2023-09-29T23:08:14.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138014f750 con 0x7f138009d9e0 2023-09-29T23:08:14.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137ffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1380152e30 con 0x7f138013d700 2023-09-29T23:08:14.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137e7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f138009ddb0 0x7f138009bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:14.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137e7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f138009ddb0 0x7f138009bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51354/0 (socket says 172.21.15.115:51354) 2023-09-29T23:08:14.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137e7fc700 1 -- 172.21.15.115:0/3170113069 learned_addr learned my addr 172.21.15.115:0/3170113069 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:14.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137f7fe700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f138013d700 0x7f13801531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:14.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.005+0000 7f137effd700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f138009d9e0 0x7f13800b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:14.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.009+0000 7f137e7fc700 1 -- 172.21.15.115:0/3170113069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f138013d700 msgr2=0x7f13801531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:14.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.009+0000 7f137e7fc700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f138013d700 0x7f13801531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:14.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.009+0000 7f137e7fc700 1 -- 172.21.15.115:0/3170113069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f138009d9e0 msgr2=0x7f13800b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:14.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.009+0000 7f137e7fc700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f138009d9e0 0x7f13800b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:14.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.009+0000 7f137e7fc700 1 -- 172.21.15.115:0/3170113069 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1378009ae0 con 0x7f138009ddb0 2023-09-29T23:08:14.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.009+0000 7f137effd700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f138009d9e0 0x7f13800b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:08:14.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.009+0000 7f137e7fc700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f138009ddb0 0x7f138009bdb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f137000c5c0 tx=0x7f137000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:14.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.009+0000 7f1366ffd700 1 -- 172.21.15.115:0/3170113069 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370011590 con 0x7f138009ddb0 2023-09-29T23:08:14.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.009+0000 7f1366ffd700 1 -- 172.21.15.115:0/3170113069 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1370011710 con 0x7f138009ddb0 2023-09-29T23:08:14.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.009+0000 7f137ffff700 1 -- 172.21.15.115:0/3170113069 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138009c7f0 con 0x7f138009ddb0 2023-09-29T23:08:14.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.009+0000 7f1366ffd700 1 -- 172.21.15.115:0/3170113069 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370011ad0 con 0x7f138009ddb0 2023-09-29T23:08:14.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.009+0000 7f137ffff700 1 -- 172.21.15.115:0/3170113069 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138009d6c0 con 0x7f138009ddb0 2023-09-29T23:08:14.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.009+0000 7f137ffff700 1 -- 172.21.15.115:0/3170113069 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138004be00 con 0x7f138009ddb0 2023-09-29T23:08:14.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.013+0000 7f1366ffd700 1 -- 172.21.15.115:0/3170113069 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f137001b3b0 con 0x7f138009ddb0 2023-09-29T23:08:14.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.013+0000 7f1366ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:14.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.013+0000 7f1366ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:14.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.013+0000 7f1366ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:14.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.013+0000 7f1366ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:14.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.013+0000 7f1366ffd700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f136c08e860 0x7f136c090d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:14.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.013+0000 7f1366ffd700 1 -- 172.21.15.115:0/3170113069 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f13700b3ed0 con 0x7f138009ddb0 2023-09-29T23:08:14.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.013+0000 7f137effd700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f136c08e860 0x7f136c090d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:14.017 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.013+0000 7f137effd700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f136c08e860 0x7f136c090d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1374007fd0 tx=0x7f1374009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:14.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.021+0000 7f1366ffd700 1 -- 172.21.15.115:0/3170113069 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1370084870 con 0x7f138009ddb0 2023-09-29T23:08:14.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.217+0000 7f137ffff700 1 -- 172.21.15.115:0/3170113069 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f13800b1410 con 0x7f138009ddb0 2023-09-29T23:08:14.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.217+0000 7f1366ffd700 1 -- 172.21.15.115:0/3170113069 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f1370017070 con 0x7f138009ddb0 2023-09-29T23:08:14.220 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:14.220 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:14.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.217+0000 7f137ffff700 10 mgrc shutdown 2023-09-29T23:08:14.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.217+0000 7f137ffff700 1 -- 172.21.15.115:0/3170113069 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f136c08e860 msgr2=0x7f136c090d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:14.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.217+0000 7f137ffff700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f136c08e860 0x7f136c090d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1374007fd0 tx=0x7f1374009040 comp rx=0 tx=0).stop 2023-09-29T23:08:14.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.217+0000 7f137ffff700 1 -- 172.21.15.115:0/3170113069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f138009ddb0 msgr2=0x7f138009bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:14.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.217+0000 7f137ffff700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f138009ddb0 0x7f138009bdb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f137000c5c0 tx=0x7f137000c980 comp rx=0 tx=0).stop 2023-09-29T23:08:14.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.217+0000 7f137ffff700 1 -- 172.21.15.115:0/3170113069 shutdown_connections 2023-09-29T23:08:14.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.217+0000 7f137ffff700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f138013d700 0x7f13801531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:14.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.221+0000 7f137ffff700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f136c08e860 0x7f136c090d10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:14.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.221+0000 7f137ffff700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f138009ddb0 0x7f138009bdb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:14.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.221+0000 7f137ffff700 1 --2- 172.21.15.115:0/3170113069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f138009d9e0 0x7f13800b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:14.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.221+0000 7f137ffff700 1 -- 172.21.15.115:0/3170113069 >> 172.21.15.115:0/3170113069 conn(0x7f13800b1d20 msgr2=0x7f13800a3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:14.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.221+0000 7f137ffff700 1 -- 172.21.15.115:0/3170113069 shutdown_connections 2023-09-29T23:08:14.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:14.221+0000 7f137ffff700 1 -- 172.21.15.115:0/3170113069 wait complete. 2023-09-29T23:08:17.235 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:17.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7635d50700 1 Processor -- start 2023-09-29T23:08:17.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7635d50700 1 -- start start 2023-09-29T23:08:17.347 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7635d50700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f76300a4140 0x7f76300670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:17.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7635d50700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76300675e0 con 0x7f763009d680 2023-09-29T23:08:17.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7635d50700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76300a3710 con 0x7f7630068130 2023-09-29T23:08:17.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7635d50700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763009bd40 con 0x7f76300a4140 2023-09-29T23:08:17.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7634d4e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f76300a4140 0x7f76300670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:17.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f762ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f763009d680 0x7f7630067a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60648/0 (socket says 172.21.15.115:60648) 2023-09-29T23:08:17.348 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f762ffff700 1 -- 172.21.15.115:0/1718751901 learned_addr learned my addr 172.21.15.115:0/1718751901 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:08:17.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7634d4e700 1 -- 172.21.15.115:0/1718751901 >> v1:172.21.15.156:6789/0 conn(0x7f7630068130 legacy=0x7f763014e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:17.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7634d4e700 1 -- 172.21.15.115:0/1718751901 >> v1:172.21.15.115:6789/0 conn(0x7f763009d680 legacy=0x7f7630067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:17.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7634d4e700 1 -- 172.21.15.115:0/1718751901 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76300a4510 con 0x7f76300a4140 2023-09-29T23:08:17.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7634d4e700 1 --2- 172.21.15.115:0/1718751901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76300a4140 0x7f76300670a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f76200098e0 tx=0x7f76200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bef6c8417eb713 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:17.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f762f7fe700 1 -- 172.21.15.115:0/1718751901 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620009e80 con 0x7f76300a4140 2023-09-29T23:08:17.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f762f7fe700 1 -- 172.21.15.115:0/1718751901 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762000b8f0 con 0x7f76300a4140 2023-09-29T23:08:17.349 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f762f7fe700 1 -- 172.21.15.115:0/1718751901 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762000bc70 con 0x7f76300a4140 2023-09-29T23:08:17.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7635d50700 1 -- 172.21.15.115:0/1718751901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76300a4140 msgr2=0x7f76300670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:17.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7635d50700 1 --2- 172.21.15.115:0/1718751901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76300a4140 0x7f76300670a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f76200098e0 tx=0x7f76200091a0 comp rx=0 tx=0).stop 2023-09-29T23:08:17.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7635d50700 1 -- 172.21.15.115:0/1718751901 shutdown_connections 2023-09-29T23:08:17.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7635d50700 1 --2- 172.21.15.115:0/1718751901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76300a4140 0x7f76300670a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:17.350 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7635d50700 1 -- 172.21.15.115:0/1718751901 >> 172.21.15.115:0/1718751901 conn(0x7f76300b1d20 msgr2=0x7f76300b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:17.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7635d50700 1 -- 172.21.15.115:0/1718751901 shutdown_connections 2023-09-29T23:08:17.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.345+0000 7f7635d50700 1 -- 172.21.15.115:0/1718751901 wait complete. 2023-09-29T23:08:17.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f7635d50700 1 Processor -- start 2023-09-29T23:08:17.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f7635d50700 1 -- start start 2023-09-29T23:08:17.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f7635d50700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7630068130 0x7f763009eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:17.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f7635d50700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f763009d680 0x7f7630144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:17.351 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f7635d50700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76300a4140 0x7f76301575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:17.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f7635d50700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76301571a0 con 0x7f76300a4140 2023-09-29T23:08:17.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f7635d50700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763009f0b0 con 0x7f7630068130 2023-09-29T23:08:17.352 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f7635d50700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76301539c0 con 0x7f763009d680 2023-09-29T23:08:17.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f763554f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76300a4140 0x7f76301575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:17.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f763554f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76300a4140 0x7f76301575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56258/0 (socket says 172.21.15.115:56258) 2023-09-29T23:08:17.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f763554f700 1 -- 172.21.15.115:0/895973575 learned_addr learned my addr 172.21.15.115:0/895973575 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:17.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f762ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f763009d680 0x7f7630144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:17.353 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f7634d4e700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7630068130 0x7f763009eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:17.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f763554f700 1 -- 172.21.15.115:0/895973575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f763009d680 msgr2=0x7f7630144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:17.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f763554f700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f763009d680 0x7f7630144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:17.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f763554f700 1 -- 172.21.15.115:0/895973575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7630068130 msgr2=0x7f763009eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:17.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f763554f700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7630068130 0x7f763009eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:17.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f763554f700 1 -- 172.21.15.115:0/895973575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7620009420 con 0x7f76300a4140 2023-09-29T23:08:17.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f7634d4e700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7630068130 0x7f763009eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:08:17.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f763554f700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76300a4140 0x7f76301575f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f761800c560 tx=0x7f7618007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:17.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f762cff9700 1 -- 172.21.15.115:0/895973575 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618011590 con 0x7f76300a4140 2023-09-29T23:08:17.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f762cff9700 1 -- 172.21.15.115:0/895973575 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76180116f0 con 0x7f76300a4140 2023-09-29T23:08:17.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f7635d50700 1 -- 172.21.15.115:0/895973575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7630144950 con 0x7f76300a4140 2023-09-29T23:08:17.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f762cff9700 1 -- 172.21.15.115:0/895973575 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618011ab0 con 0x7f76300a4140 2023-09-29T23:08:17.354 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.349+0000 7f7635d50700 1 -- 172.21.15.115:0/895973575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7630157b30 con 0x7f76300a4140 2023-09-29T23:08:17.355 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.353+0000 7f7635d50700 1 -- 172.21.15.115:0/895973575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7630157310 con 0x7f76300a4140 2023-09-29T23:08:17.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.353+0000 7f762cff9700 1 -- 172.21.15.115:0/895973575 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f761801b3b0 con 0x7f76300a4140 2023-09-29T23:08:17.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.353+0000 7f762cff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:17.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.353+0000 7f762cff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:17.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.353+0000 7f762cff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:17.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.353+0000 7f762cff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:17.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.353+0000 7f762cff9700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f761008e8b0 0x7f7610090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:17.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.353+0000 7f762cff9700 1 -- 172.21.15.115:0/895973575 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f76180b3cb0 con 0x7f76300a4140 2023-09-29T23:08:17.358 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.357+0000 7f7634d4e700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f761008e8b0 0x7f7610090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:17.359 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.357+0000 7f7634d4e700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f761008e8b0 0x7f7610090d60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76200093f0 tx=0x7f7620017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:17.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.361+0000 7f762cff9700 1 -- 172.21.15.115:0/895973575 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7630157310 con 0x7f76300a4140 2023-09-29T23:08:17.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.557+0000 7f7635d50700 1 -- 172.21.15.115:0/895973575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7630157310 con 0x7f76300a4140 2023-09-29T23:08:17.560 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.557+0000 7f762cff9700 1 -- 172.21.15.115:0/895973575 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f7630157310 con 0x7f76300a4140 2023-09-29T23:08:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:17.560 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:17.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.557+0000 7f7635d50700 10 mgrc shutdown 2023-09-29T23:08:17.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.557+0000 7f7635d50700 1 -- 172.21.15.115:0/895973575 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f761008e8b0 msgr2=0x7f7610090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:17.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.557+0000 7f7635d50700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f761008e8b0 0x7f7610090d60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76200093f0 tx=0x7f7620017000 comp rx=0 tx=0).stop 2023-09-29T23:08:17.562 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.557+0000 7f7635d50700 1 -- 172.21.15.115:0/895973575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76300a4140 msgr2=0x7f76301575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:17.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.557+0000 7f7635d50700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76300a4140 0x7f76301575f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f761800c560 tx=0x7f7618007ef0 comp rx=0 tx=0).stop 2023-09-29T23:08:17.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.557+0000 7f7635d50700 1 -- 172.21.15.115:0/895973575 shutdown_connections 2023-09-29T23:08:17.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.557+0000 7f7635d50700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f761008e8b0 0x7f7610090d60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:17.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.557+0000 7f7635d50700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76300a4140 0x7f76301575f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:17.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.557+0000 7f7635d50700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f763009d680 0x7f7630144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:17.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.557+0000 7f7635d50700 1 --2- 172.21.15.115:0/895973575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7630068130 0x7f763009eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:17.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.557+0000 7f7635d50700 1 -- 172.21.15.115:0/895973575 >> 172.21.15.115:0/895973575 conn(0x7f76300b1d20 msgr2=0x7f76300b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:17.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.561+0000 7f7635d50700 1 -- 172.21.15.115:0/895973575 shutdown_connections 2023-09-29T23:08:17.563 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:17.561+0000 7f7635d50700 1 -- 172.21.15.115:0/895973575 wait complete. 2023-09-29T23:08:20.574 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:20.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.681+0000 7f287a5d1700 1 Processor -- start 2023-09-29T23:08:20.685 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.681+0000 7f287a5d1700 1 -- start start 2023-09-29T23:08:20.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.681+0000 7f287a5d1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f287414d7f0 0x7f287414fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:20.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.681+0000 7f287a5d1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287406fbe0 con 0x7f28740a4d40 2023-09-29T23:08:20.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.681+0000 7f287a5d1700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287409b660 con 0x7f287409b040 2023-09-29T23:08:20.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.681+0000 7f287a5d1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2874141910 con 0x7f287414d7f0 2023-09-29T23:08:20.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.681+0000 7f2878b6e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f287414d7f0 0x7f287414fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:20.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.681+0000 7f2873fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f28740a4d40 0x7f2874147450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60658/0 (socket says 172.21.15.115:60658) 2023-09-29T23:08:20.686 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.681+0000 7f2873fff700 1 -- 172.21.15.115:0/2926330608 learned_addr learned my addr 172.21.15.115:0/2926330608 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:08:20.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f2872ffd700 1 -- 172.21.15.115:0/2926330608 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319300405 0 0) 0x7f287406fbe0 con 0x7f28740a4d40 2023-09-29T23:08:20.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f2878b6e700 1 -- 172.21.15.115:0/2926330608 >> v1:172.21.15.156:6789/0 conn(0x7f287409b040 legacy=0x7f28740a3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:20.687 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f2878b6e700 1 -- 172.21.15.115:0/2926330608 >> v1:172.21.15.115:6789/0 conn(0x7f28740a4d40 legacy=0x7f2874147450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:20.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f2878b6e700 1 -- 172.21.15.115:0/2926330608 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28740a5110 con 0x7f287414d7f0 2023-09-29T23:08:20.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f2878b6e700 1 --2- 172.21.15.115:0/2926330608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f287414d7f0 0x7f287414fbd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f286c009e60 tx=0x7f286c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f699ad596c24b775 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:20.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f2872ffd700 1 -- 172.21.15.115:0/2926330608 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c00e070 con 0x7f287414d7f0 2023-09-29T23:08:20.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f2872ffd700 1 -- 172.21.15.115:0/2926330608 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c00bc30 con 0x7f287414d7f0 2023-09-29T23:08:20.688 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f2872ffd700 1 -- 172.21.15.115:0/2926330608 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c012430 con 0x7f287414d7f0 2023-09-29T23:08:20.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 -- 172.21.15.115:0/2926330608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f287414d7f0 msgr2=0x7f287414fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:20.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 --2- 172.21.15.115:0/2926330608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f287414d7f0 0x7f287414fbd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f286c009e60 tx=0x7f286c009780 comp rx=0 tx=0).stop 2023-09-29T23:08:20.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 -- 172.21.15.115:0/2926330608 shutdown_connections 2023-09-29T23:08:20.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 --2- 172.21.15.115:0/2926330608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f287414d7f0 0x7f287414fbd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:20.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 -- 172.21.15.115:0/2926330608 >> 172.21.15.115:0/2926330608 conn(0x7f28740695c0 msgr2=0x7f28740699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:20.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 -- 172.21.15.115:0/2926330608 shutdown_connections 2023-09-29T23:08:20.689 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 -- 172.21.15.115:0/2926330608 wait complete. 2023-09-29T23:08:20.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 Processor -- start 2023-09-29T23:08:20.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 -- start start 2023-09-29T23:08:20.690 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f287409b040 0x7f28740a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:20.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28740a4d40 0x7f28740a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:20.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f287414d7f0 0x7f287413b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:20.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740a0d70 con 0x7f287414d7f0 2023-09-29T23:08:20.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28741572f0 con 0x7f28740a4d40 2023-09-29T23:08:20.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.685+0000 7f287a5d1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28741575b0 con 0x7f287409b040 2023-09-29T23:08:20.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f2873fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f287409b040 0x7f28740a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:20.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f2878b6e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f287414d7f0 0x7f287413b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:20.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f2873fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f287409b040 0x7f28740a00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:39238/0 (socket says 172.21.15.115:39238) 2023-09-29T23:08:20.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f2873fff700 1 -- 172.21.15.115:0/1803378626 learned_addr learned my addr 172.21.15.115:0/1803378626 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:20.691 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f28737fe700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28740a4d40 0x7f28740a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:20.692 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f2873fff700 1 -- 172.21.15.115:0/1803378626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28740a4d40 msgr2=0x7f28740a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:20.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f2873fff700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28740a4d40 0x7f28740a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:20.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f2873fff700 1 -- 172.21.15.115:0/1803378626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f287414d7f0 msgr2=0x7f287413b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:20.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f2873fff700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f287414d7f0 0x7f287413b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:20.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f2873fff700 1 -- 172.21.15.115:0/1803378626 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c009a20 con 0x7f287409b040 2023-09-29T23:08:20.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f2878b6e700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f287414d7f0 0x7f287413b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:08:20.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f2873fff700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f287409b040 0x7f28740a00a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f286800c810 tx=0x7f2868007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:20.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f285bfff700 1 -- 172.21.15.115:0/1803378626 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868005b30 con 0x7f287409b040 2023-09-29T23:08:20.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f285bfff700 1 -- 172.21.15.115:0/1803378626 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2868005c90 con 0x7f287409b040 2023-09-29T23:08:20.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f285bfff700 1 -- 172.21.15.115:0/1803378626 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868007300 con 0x7f287409b040 2023-09-29T23:08:20.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f287a5d1700 1 -- 172.21.15.115:0/1803378626 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28740a1a40 con 0x7f287409b040 2023-09-29T23:08:20.693 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f287a5d1700 1 -- 172.21.15.115:0/1803378626 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2874146f20 con 0x7f287409b040 2023-09-29T23:08:20.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.689+0000 7f287a5d1700 1 -- 172.21.15.115:0/1803378626 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28740a1200 con 0x7f287409b040 2023-09-29T23:08:20.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.693+0000 7f285bfff700 1 -- 172.21.15.115:0/1803378626 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f286801b3b0 con 0x7f287409b040 2023-09-29T23:08:20.695 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.693+0000 7f285bfff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:20.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.693+0000 7f285bfff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:20.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.693+0000 7f285bfff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:20.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.693+0000 7f285bfff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:20.696 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.693+0000 7f285bfff700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f286008e8b0 0x7f2860090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:20.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.693+0000 7f285bfff700 1 -- 172.21.15.115:0/1803378626 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f28680b3dc0 con 0x7f287409b040 2023-09-29T23:08:20.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.693+0000 7f28737fe700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f286008e8b0 0x7f2860090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:20.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.693+0000 7f28737fe700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f286008e8b0 0x7f2860090d60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f287413f9d0 tx=0x7f2864007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:20.704 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.701+0000 7f285bfff700 1 -- 172.21.15.115:0/1803378626 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f28680847f0 con 0x7f287409b040 2023-09-29T23:08:20.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.889+0000 7f287a5d1700 1 -- 172.21.15.115:0/1803378626 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2874070990 con 0x7f287409b040 2023-09-29T23:08:20.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.889+0000 7f285bfff700 1 -- 172.21.15.115:0/1803378626 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2868017080 con 0x7f287409b040 2023-09-29T23:08:20.894 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:20.894 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:20.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.893+0000 7f287a5d1700 10 mgrc shutdown 2023-09-29T23:08:20.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.893+0000 7f287a5d1700 1 -- 172.21.15.115:0/1803378626 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f286008e8b0 msgr2=0x7f2860090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:20.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.893+0000 7f287a5d1700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f286008e8b0 0x7f2860090d60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f287413f9d0 tx=0x7f2864007ec0 comp rx=0 tx=0).stop 2023-09-29T23:08:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.893+0000 7f287a5d1700 1 -- 172.21.15.115:0/1803378626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f287409b040 msgr2=0x7f28740a00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.893+0000 7f287a5d1700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f287409b040 0x7f28740a00a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f286800c810 tx=0x7f2868007df0 comp rx=0 tx=0).stop 2023-09-29T23:08:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.893+0000 7f287a5d1700 1 -- 172.21.15.115:0/1803378626 shutdown_connections 2023-09-29T23:08:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.893+0000 7f287a5d1700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f286008e8b0 0x7f2860090d60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.893+0000 7f287a5d1700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f287414d7f0 0x7f287413b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.893+0000 7f287a5d1700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28740a4d40 0x7f28740a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.893+0000 7f287a5d1700 1 --2- 172.21.15.115:0/1803378626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f287409b040 0x7f28740a00a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.893+0000 7f287a5d1700 1 -- 172.21.15.115:0/1803378626 >> 172.21.15.115:0/1803378626 conn(0x7f28740695c0 msgr2=0x7f28741445f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.893+0000 7f287a5d1700 1 -- 172.21.15.115:0/1803378626 shutdown_connections 2023-09-29T23:08:20.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:20.893+0000 7f287a5d1700 1 -- 172.21.15.115:0/1803378626 wait complete. 2023-09-29T23:08:23.909 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:24.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.017+0000 7fe4adbf9700 1 Processor -- start 2023-09-29T23:08:24.021 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.017+0000 7fe4adbf9700 1 -- start start 2023-09-29T23:08:24.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.017+0000 7fe4adbf9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a809ddb0 0x7fe4a8140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:24.022 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.017+0000 7fe4adbf9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe4a813d700 0x7fe4a809f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.017+0000 7fe4adbf9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a813e770 con 0x7fe4a809d9e0 2023-09-29T23:08:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.017+0000 7fe4adbf9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a8141d20 con 0x7fe4a813d700 2023-09-29T23:08:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.017+0000 7fe4adbf9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a813dc00 con 0x7fe4a809ddb0 2023-09-29T23:08:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.017+0000 7fe4ad3f8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe4a813d700 0x7fe4a809f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.017+0000 7fe4ad3f8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe4a813d700 0x7fe4a809f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56294/0 (socket says 172.21.15.115:56294) 2023-09-29T23:08:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.017+0000 7fe4ad3f8700 1 -- 172.21.15.115:0/240786332 learned_addr learned my addr 172.21.15.115:0/240786332 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.017+0000 7fe4a7fff700 1 --2- 172.21.15.115:0/240786332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a809ddb0 0x7fe4a8140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4ad3f8700 1 -- 172.21.15.115:0/240786332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a809ddb0 msgr2=0x7fe4a8140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4ad3f8700 1 --2- 172.21.15.115:0/240786332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a809ddb0 0x7fe4a8140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4ad3f8700 1 -- 172.21.15.115:0/240786332 >> v1:172.21.15.156:6789/0 conn(0x7fe4a809d9e0 legacy=0x7fe4a8141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4ad3f8700 1 -- 172.21.15.115:0/240786332 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a813dec0 con 0x7fe4a813d700 2023-09-29T23:08:24.023 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4ad3f8700 1 --2- 172.21.15.115:0/240786332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a813d700 0x7fe4a809f640 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00099b0 tx=0x7fe4a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb94d979e45a88b server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:24.024 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4a77fe700 1 -- 172.21.15.115:0/240786332 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0009ea0 con 0x7fe4a813d700 2023-09-29T23:08:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4a77fe700 1 -- 172.21.15.115:0/240786332 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a000b8f0 con 0x7fe4a813d700 2023-09-29T23:08:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4a77fe700 1 -- 172.21.15.115:0/240786332 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000bc90 con 0x7fe4a813d700 2023-09-29T23:08:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4adbf9700 1 -- 172.21.15.115:0/240786332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a813d700 msgr2=0x7fe4a809f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4adbf9700 1 --2- 172.21.15.115:0/240786332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a813d700 0x7fe4a809f640 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00099b0 tx=0x7fe4a0009250 comp rx=0 tx=0).stop 2023-09-29T23:08:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4adbf9700 1 -- 172.21.15.115:0/240786332 shutdown_connections 2023-09-29T23:08:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4adbf9700 1 --2- 172.21.15.115:0/240786332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a813d700 0x7fe4a809f640 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4adbf9700 1 --2- 172.21.15.115:0/240786332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a809ddb0 0x7fe4a8140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4adbf9700 1 -- 172.21.15.115:0/240786332 >> 172.21.15.115:0/240786332 conn(0x7fe4a80b1d20 msgr2=0x7fe4a80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4adbf9700 1 -- 172.21.15.115:0/240786332 shutdown_connections 2023-09-29T23:08:24.025 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.021+0000 7fe4adbf9700 1 -- 172.21.15.115:0/240786332 wait complete. 2023-09-29T23:08:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4adbf9700 1 Processor -- start 2023-09-29T23:08:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4adbf9700 1 -- start start 2023-09-29T23:08:24.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4adbf9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a809d9e0 0x7fe4a806eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:24.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4adbf9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a809ddb0 0x7fe4a813b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:24.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4adbf9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a813d700 0x7fe4a813bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:24.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4adbf9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a813c110 con 0x7fe4a809d9e0 2023-09-29T23:08:24.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4adbf9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8098aa0 con 0x7fe4a813d700 2023-09-29T23:08:24.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4adbf9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a813c320 con 0x7fe4a809ddb0 2023-09-29T23:08:24.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4acbf7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a809d9e0 0x7fe4a806eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:24.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4a7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a809ddb0 0x7fe4a813b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:24.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4a7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a809ddb0 0x7fe4a813b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:39250/0 (socket says 172.21.15.115:39250) 2023-09-29T23:08:24.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4a7fff700 1 -- 172.21.15.115:0/462600014 learned_addr learned my addr 172.21.15.115:0/462600014 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:24.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4acbf7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a809d9e0 0x7fe4a806eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56310/0 (socket says 172.21.15.115:56310) 2023-09-29T23:08:24.029 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4ad3f8700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a813d700 0x7fe4a813bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:24.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4acbf7700 1 -- 172.21.15.115:0/462600014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a809ddb0 msgr2=0x7fe4a813b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:24.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4acbf7700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a809ddb0 0x7fe4a813b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:24.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4acbf7700 1 -- 172.21.15.115:0/462600014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a813d700 msgr2=0x7fe4a813bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:24.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4acbf7700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a813d700 0x7fe4a813bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:24.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4acbf7700 1 -- 172.21.15.115:0/462600014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a00094f0 con 0x7fe4a809d9e0 2023-09-29T23:08:24.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4a7fff700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a809ddb0 0x7fe4a813b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:08:24.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4acbf7700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a809d9e0 0x7fe4a806eb00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe490001eb0 tx=0x7fe490007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:24.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4a4ff9700 1 -- 172.21.15.115:0/462600014 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe490011770 con 0x7fe4a809d9e0 2023-09-29T23:08:24.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4a4ff9700 1 -- 172.21.15.115:0/462600014 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4900118f0 con 0x7fe4a809d9e0 2023-09-29T23:08:24.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4adbf9700 1 -- 172.21.15.115:0/462600014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a8150990 con 0x7fe4a809d9e0 2023-09-29T23:08:24.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4a4ff9700 1 -- 172.21.15.115:0/462600014 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe490011cb0 con 0x7fe4a809d9e0 2023-09-29T23:08:24.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.025+0000 7fe4adbf9700 1 -- 172.21.15.115:0/462600014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a8097610 con 0x7fe4a809d9e0 2023-09-29T23:08:24.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.029+0000 7fe4adbf9700 1 -- 172.21.15.115:0/462600014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a804be00 con 0x7fe4a809d9e0 2023-09-29T23:08:24.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.029+0000 7fe4a4ff9700 1 -- 172.21.15.115:0/462600014 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fe4900223a0 con 0x7fe4a809d9e0 2023-09-29T23:08:24.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.029+0000 7fe4a4ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:24.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.029+0000 7fe4a4ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:24.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.029+0000 7fe4a4ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:24.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.029+0000 7fe4a4ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:24.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.029+0000 7fe4a4ff9700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe48808e830 0x7fe488090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:24.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.029+0000 7fe4a4ff9700 1 -- 172.21.15.115:0/462600014 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fe4900b8070 con 0x7fe4a809d9e0 2023-09-29T23:08:24.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.033+0000 7fe4a7fff700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe48808e830 0x7fe488090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:24.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.033+0000 7fe4a7fff700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe48808e830 0x7fe488090ce0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe4a813cb60 tx=0x7fe49800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:24.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.041+0000 7fe4a4ff9700 1 -- 172.21.15.115:0/462600014 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe4900e7be0 con 0x7fe4a809d9e0 2023-09-29T23:08:24.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.237+0000 7fe4adbf9700 1 -- 172.21.15.115:0/462600014 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe4a80a3700 con 0x7fe4a809d9e0 2023-09-29T23:08:24.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.237+0000 7fe4a4ff9700 1 -- 172.21.15.115:0/462600014 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fe49001e070 con 0x7fe4a809d9e0 2023-09-29T23:08:24.241 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:24.241 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:24.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.241+0000 7fe4adbf9700 10 mgrc shutdown 2023-09-29T23:08:24.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.241+0000 7fe4adbf9700 1 -- 172.21.15.115:0/462600014 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe48808e830 msgr2=0x7fe488090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:24.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.241+0000 7fe4adbf9700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe48808e830 0x7fe488090ce0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe4a813cb60 tx=0x7fe49800b040 comp rx=0 tx=0).stop 2023-09-29T23:08:24.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.241+0000 7fe4adbf9700 1 -- 172.21.15.115:0/462600014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a809d9e0 msgr2=0x7fe4a806eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:24.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.241+0000 7fe4adbf9700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a809d9e0 0x7fe4a806eb00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe490001eb0 tx=0x7fe490007ec0 comp rx=0 tx=0).stop 2023-09-29T23:08:24.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.241+0000 7fe4adbf9700 1 -- 172.21.15.115:0/462600014 shutdown_connections 2023-09-29T23:08:24.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.241+0000 7fe4adbf9700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4a813d700 0x7fe4a813bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:24.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.241+0000 7fe4adbf9700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4a809ddb0 0x7fe4a813b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:24.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.241+0000 7fe4adbf9700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fe48808e830 0x7fe488090ce0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:24.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.241+0000 7fe4adbf9700 1 --2- 172.21.15.115:0/462600014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a809d9e0 0x7fe4a806eb00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:24.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.241+0000 7fe4adbf9700 1 -- 172.21.15.115:0/462600014 >> 172.21.15.115:0/462600014 conn(0x7fe4a80b1d20 msgr2=0x7fe4a80a0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:24.245 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.241+0000 7fe4adbf9700 1 -- 172.21.15.115:0/462600014 shutdown_connections 2023-09-29T23:08:24.246 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:24.241+0000 7fe4adbf9700 1 -- 172.21.15.115:0/462600014 wait complete. 2023-09-29T23:08:27.256 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:27.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.360+0000 7f9f52e07700 1 Processor -- start 2023-09-29T23:08:27.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.360+0000 7f9f52e07700 1 -- start start 2023-09-29T23:08:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f52e07700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f4c06c190 0x7f9f4c09cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f52e07700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4c09d300 con 0x7f9f4c09e3e0 2023-09-29T23:08:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f52e07700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4c13e290 con 0x7f9f4c06bdc0 2023-09-29T23:08:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f52e07700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c13e530 con 0x7f9f4c06c190 2023-09-29T23:08:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f513a4700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9f4c09e3e0 0x7f9f4c0a5820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:48304/0 (socket says 172.21.15.115:48304) 2023-09-29T23:08:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f513a4700 1 -- 172.21.15.115:0/1083012163 learned_addr learned my addr 172.21.15.115:0/1083012163 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:08:27.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f4bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f4c06c190 0x7f9f4c09cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:27.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f4b7fe700 1 -- 172.21.15.115:0/1083012163 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085460099 0 0) 0x7f9f44001490 con 0x7f9f4c09e3e0 2023-09-29T23:08:27.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f4b7fe700 1 -- 172.21.15.115:0/1083012163 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f3c003570 con 0x7f9f4c09e3e0 2023-09-29T23:08:27.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f4b7fe700 1 -- 172.21.15.115:0/1083012163 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425150243 0 0) 0x7f9f4c13e290 con 0x7f9f4c06bdc0 2023-09-29T23:08:27.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f4b7fe700 1 -- 172.21.15.115:0/1083012163 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f44001490 con 0x7f9f4c06bdc0 2023-09-29T23:08:27.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f4bfff700 1 -- 172.21.15.115:0/1083012163 >> v1:172.21.15.156:6789/0 conn(0x7f9f4c06bdc0 legacy=0x7f9f4c13dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:27.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f4bfff700 1 -- 172.21.15.115:0/1083012163 >> v1:172.21.15.115:6789/0 conn(0x7f9f4c09e3e0 legacy=0x7f9f4c0a5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:27.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f4bfff700 1 -- 172.21.15.115:0/1083012163 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c13e7d0 con 0x7f9f4c06c190 2023-09-29T23:08:27.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f4bfff700 1 --2- 172.21.15.115:0/1083012163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f4c06c190 0x7f9f4c09cdc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009910 tx=0x7f9f380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d7ef9cfc08b6f19 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:27.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f4b7fe700 1 -- 172.21.15.115:0/1083012163 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38011630 con 0x7f9f4c06c190 2023-09-29T23:08:27.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f4b7fe700 1 -- 172.21.15.115:0/1083012163 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f38011790 con 0x7f9f4c06c190 2023-09-29T23:08:27.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f4b7fe700 1 -- 172.21.15.115:0/1083012163 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38011b10 con 0x7f9f4c06c190 2023-09-29T23:08:27.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f52e07700 1 -- 172.21.15.115:0/1083012163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f4c06c190 msgr2=0x7f9f4c09cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:27.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f52e07700 1 --2- 172.21.15.115:0/1083012163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f4c06c190 0x7f9f4c09cdc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009910 tx=0x7f9f380091a0 comp rx=0 tx=0).stop 2023-09-29T23:08:27.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f52e07700 1 -- 172.21.15.115:0/1083012163 shutdown_connections 2023-09-29T23:08:27.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f52e07700 1 --2- 172.21.15.115:0/1083012163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f4c06c190 0x7f9f4c09cdc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:27.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f52e07700 1 -- 172.21.15.115:0/1083012163 >> 172.21.15.115:0/1083012163 conn(0x7f9f4c0b4bc0 msgr2=0x7f9f4c06b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:27.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f52e07700 1 -- 172.21.15.115:0/1083012163 shutdown_connections 2023-09-29T23:08:27.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.364+0000 7f9f52e07700 1 -- 172.21.15.115:0/1083012163 wait complete. 2023-09-29T23:08:27.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f52e07700 1 Processor -- start 2023-09-29T23:08:27.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f52e07700 1 -- start start 2023-09-29T23:08:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f52e07700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f4c06bdc0 0x7f9f4c0a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f52e07700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f4c06c190 0x7f9f4c14fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f52e07700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f4c09e3e0 0x7f9f4c1407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f52e07700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c14f390 con 0x7f9f4c06c190 2023-09-29T23:08:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f52e07700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c06a840 con 0x7f9f4c09e3e0 2023-09-29T23:08:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f52e07700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c068a40 con 0x7f9f4c06bdc0 2023-09-29T23:08:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f4bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f4c06c190 0x7f9f4c14fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f4bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f4c06c190 0x7f9f4c14fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44140/0 (socket says 172.21.15.115:44140) 2023-09-29T23:08:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f4bfff700 1 -- 172.21.15.115:0/3980455866 learned_addr learned my addr 172.21.15.115:0/3980455866 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f50ba3700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f4c06bdc0 0x7f9f4c0a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f513a4700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f4c09e3e0 0x7f9f4c1407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f4bfff700 1 -- 172.21.15.115:0/3980455866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f4c06bdc0 msgr2=0x7f9f4c0a0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f4bfff700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f4c06bdc0 0x7f9f4c0a0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f4bfff700 1 -- 172.21.15.115:0/3980455866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f4c09e3e0 msgr2=0x7f9f4c1407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f4bfff700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f4c09e3e0 0x7f9f4c1407e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f4bfff700 1 -- 172.21.15.115:0/3980455866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f38009420 con 0x7f9f4c06c190 2023-09-29T23:08:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f4bfff700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f4c06c190 0x7f9f4c14fda0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009860 tx=0x7f9f38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f48ff9700 1 -- 172.21.15.115:0/3980455866 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38011b10 con 0x7f9f4c06c190 2023-09-29T23:08:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f48ff9700 1 -- 172.21.15.115:0/3980455866 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f38000d10 con 0x7f9f4c06c190 2023-09-29T23:08:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f52e07700 1 -- 172.21.15.115:0/3980455866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4c068f30 con 0x7f9f4c06c190 2023-09-29T23:08:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f48ff9700 1 -- 172.21.15.115:0/3980455866 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38025630 con 0x7f9f4c06c190 2023-09-29T23:08:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.368+0000 7f9f52e07700 1 -- 172.21.15.115:0/3980455866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c0a1420 con 0x7f9f4c06c190 2023-09-29T23:08:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.372+0000 7f9f52e07700 1 -- 172.21.15.115:0/3980455866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4c070990 con 0x7f9f4c06c190 2023-09-29T23:08:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.372+0000 7f9f48ff9700 1 -- 172.21.15.115:0/3980455866 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f9f3802e440 con 0x7f9f4c06c190 2023-09-29T23:08:27.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.372+0000 7f9f48ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:27.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.372+0000 7f9f48ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:27.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.372+0000 7f9f48ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:27.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.372+0000 7f9f48ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:27.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.372+0000 7f9f48ff9700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f9f3008e8b0 0x7f9f30090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:27.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.376+0000 7f9f50ba3700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f9f3008e8b0 0x7f9f30090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:27.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.376+0000 7f9f48ff9700 1 -- 172.21.15.115:0/3980455866 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f9f380b5ff0 con 0x7f9f4c06c190 2023-09-29T23:08:27.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.376+0000 7f9f50ba3700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f9f3008e8b0 0x7f9f30090d60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f40007fd0 tx=0x7f9f40007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:27.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.380+0000 7f9f48ff9700 1 -- 172.21.15.115:0/3980455866 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9f38086980 con 0x7f9f4c06c190 2023-09-29T23:08:27.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 1 -- 172.21.15.115:0/3980455866 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9f4c068c70 con 0x7f9f4c06c190 2023-09-29T23:08:27.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f48ff9700 1 -- 172.21.15.115:0/3980455866 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f9f38015100 con 0x7f9f4c06c190 2023-09-29T23:08:27.579 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:27.579 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:27.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 10 mgrc shutdown 2023-09-29T23:08:27.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 1 -- 172.21.15.115:0/3980455866 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f9f3008e8b0 msgr2=0x7f9f30090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:27.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f9f3008e8b0 0x7f9f30090d60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f40007fd0 tx=0x7f9f40007d50 comp rx=0 tx=0).stop 2023-09-29T23:08:27.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 1 -- 172.21.15.115:0/3980455866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f4c06c190 msgr2=0x7f9f4c14fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:27.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f4c06c190 0x7f9f4c14fda0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009860 tx=0x7f9f38017000 comp rx=0 tx=0).stop 2023-09-29T23:08:27.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 1 -- 172.21.15.115:0/3980455866 shutdown_connections 2023-09-29T23:08:27.582 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9f4c09e3e0 0x7f9f4c1407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:27.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f9f3008e8b0 0x7f9f30090d60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:27.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f4c06c190 0x7f9f4c14fda0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:27.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 1 --2- 172.21.15.115:0/3980455866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f4c06bdc0 0x7f9f4c0a0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:27.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 1 -- 172.21.15.115:0/3980455866 >> 172.21.15.115:0/3980455866 conn(0x7f9f4c0b4bc0 msgr2=0x7f9f4c0677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:27.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 1 -- 172.21.15.115:0/3980455866 shutdown_connections 2023-09-29T23:08:27.583 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:27.576+0000 7f9f52e07700 1 -- 172.21.15.115:0/3980455866 wait complete. 2023-09-29T23:08:30.598 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:30.709 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.704+0000 7fa605f87700 1 Processor -- start 2023-09-29T23:08:30.710 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.704+0000 7fa605f87700 1 -- start start 2023-09-29T23:08:30.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.704+0000 7fa605f87700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa60009fc60 0x7fa6000a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:30.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.704+0000 7fa605f87700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa60013fe10 0x7fa600140270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:30.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.704+0000 7fa605f87700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6000a0030 con 0x7fa600142e50 2023-09-29T23:08:30.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.704+0000 7fa605f87700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6000a1ac0 con 0x7fa60013fe10 2023-09-29T23:08:30.711 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.704+0000 7fa605f87700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60013fb70 con 0x7fa60009fc60 2023-09-29T23:08:30.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.704+0000 7fa604f85700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa60009fc60 0x7fa6000a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:30.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.704+0000 7fa5fffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa600142e50 0x7fa6001434f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:48306/0 (socket says 172.21.15.115:48306) 2023-09-29T23:08:30.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.704+0000 7fa605786700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa60013fe10 0x7fa600140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:30.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.704+0000 7fa5fffff700 1 -- 172.21.15.115:0/2775889877 learned_addr learned my addr 172.21.15.115:0/2775889877 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:08:30.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa604f85700 1 -- 172.21.15.115:0/2775889877 >> v2:172.21.15.115:3300/0 conn(0x7fa60013fe10 msgr2=0x7fa600140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:30.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa604f85700 1 --2- 172.21.15.115:0/2775889877 >> v2:172.21.15.115:3300/0 conn(0x7fa60013fe10 0x7fa600140270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:30.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa604f85700 1 -- 172.21.15.115:0/2775889877 >> v1:172.21.15.115:6789/0 conn(0x7fa600142e50 legacy=0x7fa6001434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:30.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa604f85700 1 -- 172.21.15.115:0/2775889877 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60013f8d0 con 0x7fa60009fc60 2023-09-29T23:08:30.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa5ff7fe700 1 -- 172.21.15.115:0/2775889877 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695005185 0 0) 0x7fa6000a0030 con 0x7fa600142e50 2023-09-29T23:08:30.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa604f85700 1 --2- 172.21.15.115:0/2775889877 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa60009fc60 0x7fa6000a1580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40098e0 tx=0x7fa5f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c98d909fb404078 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:30.712 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa5ff7fe700 1 -- 172.21.15.115:0/2775889877 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f400b640 con 0x7fa60009fc60 2023-09-29T23:08:30.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa5ff7fe700 1 -- 172.21.15.115:0/2775889877 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f400b7a0 con 0x7fa60009fc60 2023-09-29T23:08:30.713 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa5ff7fe700 1 -- 172.21.15.115:0/2775889877 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f400bb40 con 0x7fa60009fc60 2023-09-29T23:08:30.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 -- 172.21.15.115:0/2775889877 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa60009fc60 msgr2=0x7fa6000a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:30.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 --2- 172.21.15.115:0/2775889877 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa60009fc60 0x7fa6000a1580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40098e0 tx=0x7fa5f40091a0 comp rx=0 tx=0).stop 2023-09-29T23:08:30.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 -- 172.21.15.115:0/2775889877 shutdown_connections 2023-09-29T23:08:30.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 --2- 172.21.15.115:0/2775889877 >> v2:172.21.15.115:3300/0 conn(0x7fa60013fe10 0x7fa600140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:30.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 --2- 172.21.15.115:0/2775889877 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa60009fc60 0x7fa6000a1580 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:30.715 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 -- 172.21.15.115:0/2775889877 >> 172.21.15.115:0/2775889877 conn(0x7fa6000b6c10 msgr2=0x7fa600067bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:30.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 -- 172.21.15.115:0/2775889877 shutdown_connections 2023-09-29T23:08:30.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 -- 172.21.15.115:0/2775889877 wait complete. 2023-09-29T23:08:30.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 Processor -- start 2023-09-29T23:08:30.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 -- start start 2023-09-29T23:08:30.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa60009fc60 0x7fa6000aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:30.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa60013fe10 0x7fa6000ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:30.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa600142e50 0x7fa6000ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:30.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000ade60 con 0x7fa60013fe10 2023-09-29T23:08:30.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000ae590 con 0x7fa600142e50 2023-09-29T23:08:30.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605f87700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000b36f0 con 0x7fa60009fc60 2023-09-29T23:08:30.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa604f85700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa60009fc60 0x7fa6000aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:30.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa604f85700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa60009fc60 0x7fa6000aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:40212/0 (socket says 172.21.15.115:40212) 2023-09-29T23:08:30.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa604f85700 1 -- 172.21.15.115:0/1238792300 learned_addr learned my addr 172.21.15.115:0/1238792300 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:30.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa5fffff700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa60013fe10 0x7fa6000ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:30.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa605786700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa600142e50 0x7fa6000ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:30.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.708+0000 7fa604f85700 1 -- 172.21.15.115:0/1238792300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa600142e50 msgr2=0x7fa6000ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:30.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.712+0000 7fa604f85700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa600142e50 0x7fa6000ad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:30.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.712+0000 7fa604f85700 1 -- 172.21.15.115:0/1238792300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa60013fe10 msgr2=0x7fa6000ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:30.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.712+0000 7fa604f85700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa60013fe10 0x7fa6000ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:30.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.712+0000 7fa604f85700 1 -- 172.21.15.115:0/1238792300 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f4009420 con 0x7fa60009fc60 2023-09-29T23:08:30.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.712+0000 7fa605786700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa600142e50 0x7fa6000ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:08:30.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.712+0000 7fa5fffff700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa60013fe10 0x7fa6000ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:08:30.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.712+0000 7fa604f85700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa60009fc60 0x7fa6000aecc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa60013fcb0 tx=0x7fa5f4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:30.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.712+0000 7fa5fcff9700 1 -- 172.21.15.115:0/1238792300 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f400bb20 con 0x7fa60009fc60 2023-09-29T23:08:30.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.712+0000 7fa5fcff9700 1 -- 172.21.15.115:0/1238792300 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4011420 con 0x7fa60009fc60 2023-09-29T23:08:30.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.712+0000 7fa605f87700 1 -- 172.21.15.115:0/1238792300 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6000a9af0 con 0x7fa60009fc60 2023-09-29T23:08:30.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.712+0000 7fa5fcff9700 1 -- 172.21.15.115:0/1238792300 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f40117a0 con 0x7fa60009fc60 2023-09-29T23:08:30.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.712+0000 7fa605f87700 1 -- 172.21.15.115:0/1238792300 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6000ab4d0 con 0x7fa60009fc60 2023-09-29T23:08:30.718 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.712+0000 7fa605f87700 1 -- 172.21.15.115:0/1238792300 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6000b38b0 con 0x7fa60009fc60 2023-09-29T23:08:30.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.716+0000 7fa5fcff9700 1 -- 172.21.15.115:0/1238792300 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fa5f4011b50 con 0x7fa60009fc60 2023-09-29T23:08:30.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.716+0000 7fa5fcff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:30.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.716+0000 7fa5fcff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:30.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.716+0000 7fa5fcff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:30.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.716+0000 7fa5fcff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:30.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.716+0000 7fa5fcff9700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa5ec08e8b0 0x7fa5ec090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:30.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.716+0000 7fa5fcff9700 1 -- 172.21.15.115:0/1238792300 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fa5f40b6350 con 0x7fa60009fc60 2023-09-29T23:08:30.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.716+0000 7fa5fffff700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa5ec08e8b0 0x7fa5ec090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:30.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.716+0000 7fa5fffff700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa5ec08e8b0 0x7fa5ec090d60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa6000a5c40 tx=0x7fa5f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:30.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.720+0000 7fa5fcff9700 1 -- 172.21.15.115:0/1238792300 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa5f4086cf0 con 0x7fa60009fc60 2023-09-29T23:08:30.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa605f87700 1 -- 172.21.15.115:0/1238792300 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa60004be00 con 0x7fa60009fc60 2023-09-29T23:08:30.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa5fcff9700 1 -- 172.21.15.115:0/1238792300 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa5f402a100 con 0x7fa60009fc60 2023-09-29T23:08:30.916 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:30.916 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:30.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa605f87700 10 mgrc shutdown 2023-09-29T23:08:30.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa605f87700 1 -- 172.21.15.115:0/1238792300 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa5ec08e8b0 msgr2=0x7fa5ec090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:30.918 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa605f87700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa5ec08e8b0 0x7fa5ec090d60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa6000a5c40 tx=0x7fa5f0009040 comp rx=0 tx=0).stop 2023-09-29T23:08:30.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa605f87700 1 -- 172.21.15.115:0/1238792300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa60009fc60 msgr2=0x7fa6000aecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:30.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa605f87700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa60009fc60 0x7fa6000aecc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa60013fcb0 tx=0x7fa5f4017000 comp rx=0 tx=0).stop 2023-09-29T23:08:30.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa605f87700 1 -- 172.21.15.115:0/1238792300 shutdown_connections 2023-09-29T23:08:30.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa605f87700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa600142e50 0x7fa6000ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:30.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa605f87700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa5ec08e8b0 0x7fa5ec090d60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:30.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa605f87700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa60013fe10 0x7fa6000ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:30.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa605f87700 1 --2- 172.21.15.115:0/1238792300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa60009fc60 0x7fa6000aecc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:30.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa605f87700 1 -- 172.21.15.115:0/1238792300 >> 172.21.15.115:0/1238792300 conn(0x7fa6000b6c10 msgr2=0x7fa6000b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:30.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.912+0000 7fa605f87700 1 -- 172.21.15.115:0/1238792300 shutdown_connections 2023-09-29T23:08:30.919 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:30.916+0000 7fa605f87700 1 -- 172.21.15.115:0/1238792300 wait complete. 2023-09-29T23:08:33.931 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:34.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.036+0000 7fd6d7fff700 1 Processor -- start 2023-09-29T23:08:34.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.036+0000 7fd6d7fff700 1 -- start start 2023-09-29T23:08:34.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd6d8143270 0x7fd6d81436d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:34.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d7fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d80a4830 con 0x7fd6d8067b60 2023-09-29T23:08:34.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d7fff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d8067f30 con 0x7fd6d806e860 2023-09-29T23:08:34.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d7fff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d806fa30 con 0x7fd6d8143270 2023-09-29T23:08:34.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d6ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd6d8067b60 0x7fd6d80a3e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:48310/0 (socket says 172.21.15.115:48310) 2023-09-29T23:08:34.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d6ffd700 1 -- 172.21.15.115:0/3411281244 learned_addr learned my addr 172.21.15.115:0/3411281244 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:08:34.044 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d77fe700 1 --2- 172.21.15.115:0/3411281244 >> v2:172.21.15.156:3300/0 conn(0x7fd6d8143270 0x7fd6d81436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:34.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678038472 0 0) 0x7fd6d80a4830 con 0x7fd6d8067b60 2023-09-29T23:08:34.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c4003570 con 0x7fd6d8067b60 2023-09-29T23:08:34.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624521661 0 0) 0x7fd6d8067f30 con 0x7fd6d806e860 2023-09-29T23:08:34.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d80a4830 con 0x7fd6d806e860 2023-09-29T23:08:34.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3094417841 0 0) 0x7fd6c4003570 con 0x7fd6d8067b60 2023-09-29T23:08:34.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 >> v2:172.21.15.156:3300/0 conn(0x7fd6d8143270 msgr2=0x7fd6d81436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:34.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 --2- 172.21.15.115:0/3411281244 >> v2:172.21.15.156:3300/0 conn(0x7fd6d8143270 0x7fd6d81436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:34.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 >> v1:172.21.15.156:6789/0 conn(0x7fd6d806e860 legacy=0x7fd6d806ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:34.046 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d806e410 con 0x7fd6d8067b60 2023-09-29T23:08:34.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3987234196 0 0) 0x7fd6c8001470 con 0x7fd6d8067b60 2023-09-29T23:08:34.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 >> v1:172.21.15.115:6789/0 conn(0x7fd6d8067b60 legacy=0x7fd6d80a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:34.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 --2- 172.21.15.115:0/3411281244 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c4003bf0 0x7fd6c4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:34.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 --2- 172.21.15.115:0/3411281244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c4004810 0x7fd6c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:34.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 --2- 172.21.15.115:0/3411281244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6c40051c0 0x7fd6c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:34.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d806fa30 con 0x7fd6c4004810 2023-09-29T23:08:34.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c400c160 con 0x7fd6c40051c0 2023-09-29T23:08:34.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c400c320 con 0x7fd6c4003bf0 2023-09-29T23:08:34.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d6ffd700 1 --2- 172.21.15.115:0/3411281244 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c4003bf0 0x7fd6c4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:34.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d67fc700 1 --2- 172.21.15.115:0/3411281244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c4004810 0x7fd6c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:34.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d77fe700 1 --2- 172.21.15.115:0/3411281244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6c40051c0 0x7fd6c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:34.047 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d6ffd700 1 -- 172.21.15.115:0/3411281244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6c40051c0 msgr2=0x7fd6c400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:34.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d6ffd700 1 --2- 172.21.15.115:0/3411281244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6c40051c0 0x7fd6c400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:34.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d6ffd700 1 -- 172.21.15.115:0/3411281244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c4004810 msgr2=0x7fd6c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:34.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d6ffd700 1 --2- 172.21.15.115:0/3411281244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c4004810 0x7fd6c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:34.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d6ffd700 1 -- 172.21.15.115:0/3411281244 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c4003570 con 0x7fd6c4003bf0 2023-09-29T23:08:34.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d77fe700 1 -- 172.21.15.115:0/3411281244 reap_dead start 2023-09-29T23:08:34.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d6ffd700 1 --2- 172.21.15.115:0/3411281244 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c4003bf0 0x7fd6c4003fe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800c2a0 tx=0x7fd6c8001e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e846f397f32cf255 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:34.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800cb90 con 0x7fd6c4003bf0 2023-09-29T23:08:34.048 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c800ccf0 con 0x7fd6c4003bf0 2023-09-29T23:08:34.049 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.040+0000 7fd6d5ffb700 1 -- 172.21.15.115:0/3411281244 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8005b70 con 0x7fd6c4003bf0 2023-09-29T23:08:34.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 -- 172.21.15.115:0/3411281244 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c4003bf0 msgr2=0x7fd6c4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:34.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 --2- 172.21.15.115:0/3411281244 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c4003bf0 0x7fd6c4003fe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800c2a0 tx=0x7fd6c8001e10 comp rx=0 tx=0).stop 2023-09-29T23:08:34.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 -- 172.21.15.115:0/3411281244 shutdown_connections 2023-09-29T23:08:34.051 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 --2- 172.21.15.115:0/3411281244 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c4003bf0 0x7fd6c4003fe0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:34.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 -- 172.21.15.115:0/3411281244 >> 172.21.15.115:0/3411281244 conn(0x7fd6d8068a40 msgr2=0x7fd6d8068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:34.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 -- 172.21.15.115:0/3411281244 shutdown_connections 2023-09-29T23:08:34.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 -- 172.21.15.115:0/3411281244 wait complete. 2023-09-29T23:08:34.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 Processor -- start 2023-09-29T23:08:34.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 -- start start 2023-09-29T23:08:34.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c4003bf0 0x7fd6d809e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:34.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6d809eb60 0x7fd6d814f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:34.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6d814faf0 0x7fd6d8152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:34.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d814ff60 con 0x7fd6c4003bf0 2023-09-29T23:08:34.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d809ded0 con 0x7fd6d809eb60 2023-09-29T23:08:34.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d7fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d809dc60 con 0x7fd6d814faf0 2023-09-29T23:08:34.052 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c4003bf0 0x7fd6d809e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:34.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c4003bf0 0x7fd6d809e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44166/0 (socket says 172.21.15.115:44166) 2023-09-29T23:08:34.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d6ffd700 1 -- 172.21.15.115:0/2488579678 learned_addr learned my addr 172.21.15.115:0/2488579678 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:34.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d67fc700 1 --2- 172.21.15.115:0/2488579678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6d809eb60 0x7fd6d814f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:34.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6d814faf0 0x7fd6d8152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:34.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d6ffd700 1 -- 172.21.15.115:0/2488579678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6d814faf0 msgr2=0x7fd6d8152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:34.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d6ffd700 1 --2- 172.21.15.115:0/2488579678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6d814faf0 0x7fd6d8152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:34.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d6ffd700 1 -- 172.21.15.115:0/2488579678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6d809eb60 msgr2=0x7fd6d814f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:34.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d6ffd700 1 --2- 172.21.15.115:0/2488579678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6d809eb60 0x7fd6d814f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:34.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.044+0000 7fd6d6ffd700 1 -- 172.21.15.115:0/2488579678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d8150180 con 0x7fd6c4003bf0 2023-09-29T23:08:34.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.048+0000 7fd6d6ffd700 1 --2- 172.21.15.115:0/2488579678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c4003bf0 0x7fd6d809e620 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8004ae0 tx=0x7fd6c8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:34.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.048+0000 7fd6ceffd700 1 -- 172.21.15.115:0/2488579678 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800ce60 con 0x7fd6c4003bf0 2023-09-29T23:08:34.053 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.048+0000 7fd6ceffd700 1 -- 172.21.15.115:0/2488579678 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c80070d0 con 0x7fd6c4003bf0 2023-09-29T23:08:34.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.048+0000 7fd6d7fff700 1 -- 172.21.15.115:0/2488579678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d8150440 con 0x7fd6c4003bf0 2023-09-29T23:08:34.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.048+0000 7fd6ceffd700 1 -- 172.21.15.115:0/2488579678 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8007490 con 0x7fd6c4003bf0 2023-09-29T23:08:34.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.048+0000 7fd6d7fff700 1 -- 172.21.15.115:0/2488579678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d81530b0 con 0x7fd6c4003bf0 2023-09-29T23:08:34.054 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.048+0000 7fd6d7fff700 1 -- 172.21.15.115:0/2488579678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d809b3d0 con 0x7fd6c4003bf0 2023-09-29T23:08:34.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.052+0000 7fd6ceffd700 1 -- 172.21.15.115:0/2488579678 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fd6c8028460 con 0x7fd6c4003bf0 2023-09-29T23:08:34.056 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.052+0000 7fd6ceffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:34.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.052+0000 7fd6ceffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:34.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.052+0000 7fd6ceffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:34.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.052+0000 7fd6ceffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:34.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.052+0000 7fd6ceffd700 1 --2- 172.21.15.115:0/2488579678 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd6b808e8b0 0x7fd6b8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:34.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.052+0000 7fd6ceffd700 1 -- 172.21.15.115:0/2488579678 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fd6c80b5910 con 0x7fd6c4003bf0 2023-09-29T23:08:34.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.052+0000 7fd6d67fc700 1 --2- 172.21.15.115:0/2488579678 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd6b808e8b0 0x7fd6b8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:34.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.056+0000 7fd6d67fc700 1 --2- 172.21.15.115:0/2488579678 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd6b808e8b0 0x7fd6b8090d60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00010e0 tx=0x7fd6c0007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:34.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.056+0000 7fd6ceffd700 1 -- 172.21.15.115:0/2488579678 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd6c80862a0 con 0x7fd6c4003bf0 2023-09-29T23:08:34.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.244+0000 7fd6d7fff700 1 -- 172.21.15.115:0/2488579678 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd6d804be00 con 0x7fd6c4003bf0 2023-09-29T23:08:34.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6ceffd700 1 -- 172.21.15.115:0/2488579678 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fd6c8017080 con 0x7fd6c4003bf0 2023-09-29T23:08:34.251 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:34.251 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:34.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6d7fff700 10 mgrc shutdown 2023-09-29T23:08:34.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6d7fff700 1 -- 172.21.15.115:0/2488579678 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd6b808e8b0 msgr2=0x7fd6b8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:34.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6d7fff700 1 --2- 172.21.15.115:0/2488579678 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd6b808e8b0 0x7fd6b8090d60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00010e0 tx=0x7fd6c0007d30 comp rx=0 tx=0).stop 2023-09-29T23:08:34.253 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6d7fff700 1 -- 172.21.15.115:0/2488579678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c4003bf0 msgr2=0x7fd6d809e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:34.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6d7fff700 1 --2- 172.21.15.115:0/2488579678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c4003bf0 0x7fd6d809e620 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8004ae0 tx=0x7fd6c8015000 comp rx=0 tx=0).stop 2023-09-29T23:08:34.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6d7fff700 1 -- 172.21.15.115:0/2488579678 shutdown_connections 2023-09-29T23:08:34.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6d7fff700 1 --2- 172.21.15.115:0/2488579678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6d814faf0 0x7fd6d8152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:34.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6d7fff700 1 --2- 172.21.15.115:0/2488579678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6d809eb60 0x7fd6d814f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:34.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6d7fff700 1 --2- 172.21.15.115:0/2488579678 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd6b808e8b0 0x7fd6b8090d60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:34.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6d7fff700 1 --2- 172.21.15.115:0/2488579678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c4003bf0 0x7fd6d809e620 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:34.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6d7fff700 1 -- 172.21.15.115:0/2488579678 >> 172.21.15.115:0/2488579678 conn(0x7fd6d8068a40 msgr2=0x7fd6d8141a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:34.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6d7fff700 1 -- 172.21.15.115:0/2488579678 shutdown_connections 2023-09-29T23:08:34.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:34.248+0000 7fd6d7fff700 1 -- 172.21.15.115:0/2488579678 wait complete. 2023-09-29T23:08:37.265 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:37.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc075079700 1 Processor -- start 2023-09-29T23:08:37.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc075079700 1 -- start start 2023-09-29T23:08:37.377 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc075079700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc070142e50 0x7fc0701434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:37.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc075079700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc070143a30 0x7fc07013fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:37.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc075079700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0700a0030 con 0x7fc07009fc60 2023-09-29T23:08:37.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc075079700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07013fb70 con 0x7fc070143a30 2023-09-29T23:08:37.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc075079700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07013f8d0 con 0x7fc070142e50 2023-09-29T23:08:37.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc06f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc070142e50 0x7fc0701434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:37.378 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc06f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc070142e50 0x7fc0701434f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:48004/0 (socket says 172.21.15.115:48004) 2023-09-29T23:08:37.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc06f7fe700 1 -- 172.21.15.115:0/2406395221 learned_addr learned my addr 172.21.15.115:0/2406395221 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:37.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc074878700 1 --2- 172.21.15.115:0/2406395221 >> v2:172.21.15.156:3300/0 conn(0x7fc070143a30 0x7fc07013fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:37.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc06f7fe700 1 -- 172.21.15.115:0/2406395221 >> v2:172.21.15.156:3300/0 conn(0x7fc070143a30 msgr2=0x7fc07013fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:37.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc06f7fe700 1 --2- 172.21.15.115:0/2406395221 >> v2:172.21.15.156:3300/0 conn(0x7fc070143a30 0x7fc07013fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:37.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc06f7fe700 1 -- 172.21.15.115:0/2406395221 >> v1:172.21.15.156:6789/0 conn(0x7fc07009fc60 legacy=0x7fc0700a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:37.379 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc06f7fe700 1 -- 172.21.15.115:0/2406395221 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070140350 con 0x7fc070142e50 2023-09-29T23:08:37.380 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc06f7fe700 1 --2- 172.21.15.115:0/2406395221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc070142e50 0x7fc0701434f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0580099b0 tx=0x7fc058009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c30e3028a4c1fdc6 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:37.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.372+0000 7fc06effd700 1 -- 172.21.15.115:0/2406395221 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05800b8f0 con 0x7fc070142e50 2023-09-29T23:08:37.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc06effd700 1 -- 172.21.15.115:0/2406395221 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05800ba50 con 0x7fc070142e50 2023-09-29T23:08:37.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc06effd700 1 -- 172.21.15.115:0/2406395221 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05800bdf0 con 0x7fc070142e50 2023-09-29T23:08:37.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 -- 172.21.15.115:0/2406395221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc070142e50 msgr2=0x7fc0701434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:37.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 --2- 172.21.15.115:0/2406395221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc070142e50 0x7fc0701434f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0580099b0 tx=0x7fc058009250 comp rx=0 tx=0).stop 2023-09-29T23:08:37.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 -- 172.21.15.115:0/2406395221 shutdown_connections 2023-09-29T23:08:37.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 --2- 172.21.15.115:0/2406395221 >> v2:172.21.15.156:3300/0 conn(0x7fc070143a30 0x7fc07013fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:37.381 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 --2- 172.21.15.115:0/2406395221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc070142e50 0x7fc0701434f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:37.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 -- 172.21.15.115:0/2406395221 >> 172.21.15.115:0/2406395221 conn(0x7fc0700b6c10 msgr2=0x7fc070067bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:37.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 -- 172.21.15.115:0/2406395221 shutdown_connections 2023-09-29T23:08:37.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 -- 172.21.15.115:0/2406395221 wait complete. 2023-09-29T23:08:37.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 Processor -- start 2023-09-29T23:08:37.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 -- start start 2023-09-29T23:08:37.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc07009fc60 0x7fc0700adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:37.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc070142e50 0x7fc0700a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:37.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc070143a30 0x7fc070152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:37.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700a9a50 con 0x7fc070143a30 2023-09-29T23:08:37.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700ae1e0 con 0x7fc07009fc60 2023-09-29T23:08:37.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc075079700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc070152b20 con 0x7fc070142e50 2023-09-29T23:08:37.384 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc074878700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc070143a30 0x7fc070152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:37.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc074878700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc070143a30 0x7fc070152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57636/0 (socket says 172.21.15.115:57636) 2023-09-29T23:08:37.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc06f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc070142e50 0x7fc0700a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:37.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc074878700 1 -- 172.21.15.115:0/1581063302 learned_addr learned my addr 172.21.15.115:0/1581063302 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:37.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc06ffff700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc07009fc60 0x7fc0700adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:37.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.376+0000 7fc074878700 1 -- 172.21.15.115:0/1581063302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc070142e50 msgr2=0x7fc0700a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:37.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc074878700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc070142e50 0x7fc0700a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:37.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc074878700 1 -- 172.21.15.115:0/1581063302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc07009fc60 msgr2=0x7fc0700adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:37.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc074878700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc07009fc60 0x7fc0700adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:37.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc074878700 1 -- 172.21.15.115:0/1581063302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0580094f0 con 0x7fc070143a30 2023-09-29T23:08:37.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc06ffff700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc07009fc60 0x7fc0700adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:08:37.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc074878700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc070143a30 0x7fc070152fb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc06000d860 tx=0x7fc060008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:37.385 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc067fff700 1 -- 172.21.15.115:0/1581063302 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0600125f0 con 0x7fc070143a30 2023-09-29T23:08:37.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc067fff700 1 -- 172.21.15.115:0/1581063302 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc060012770 con 0x7fc070143a30 2023-09-29T23:08:37.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc075079700 1 -- 172.21.15.115:0/1581063302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0700a9c80 con 0x7fc070143a30 2023-09-29T23:08:37.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc067fff700 1 -- 172.21.15.115:0/1581063302 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060012b30 con 0x7fc070143a30 2023-09-29T23:08:37.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc075079700 1 -- 172.21.15.115:0/1581063302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0700a55c0 con 0x7fc070143a30 2023-09-29T23:08:37.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc075079700 1 -- 172.21.15.115:0/1581063302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc070152cb0 con 0x7fc070143a30 2023-09-29T23:08:37.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc067fff700 1 -- 172.21.15.115:0/1581063302 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc06001e460 con 0x7fc070143a30 2023-09-29T23:08:37.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.380+0000 7fc067fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:37.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.384+0000 7fc067fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:37.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.384+0000 7fc067fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:37.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.384+0000 7fc067fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:37.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.384+0000 7fc067fff700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc05008e8b0 0x7fc050090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:37.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.384+0000 7fc067fff700 1 -- 172.21.15.115:0/1581063302 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fc0600b5890 con 0x7fc070143a30 2023-09-29T23:08:37.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.384+0000 7fc06ffff700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc05008e8b0 0x7fc050090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:37.388 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.384+0000 7fc06ffff700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc05008e8b0 0x7fc050090d60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc068007fd0 tx=0x7fc068009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:37.393 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.388+0000 7fc067fff700 1 -- 172.21.15.115:0/1581063302 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc060086230 con 0x7fc070143a30 2023-09-29T23:08:37.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.580+0000 7fc075079700 1 -- 172.21.15.115:0/1581063302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc07004be00 con 0x7fc070143a30 2023-09-29T23:08:37.587 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc067fff700 1 -- 172.21.15.115:0/1581063302 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fc060089850 con 0x7fc070143a30 2023-09-29T23:08:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:37.587 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:37.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc075079700 10 mgrc shutdown 2023-09-29T23:08:37.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc075079700 1 -- 172.21.15.115:0/1581063302 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc05008e8b0 msgr2=0x7fc050090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:37.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc075079700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc05008e8b0 0x7fc050090d60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc068007fd0 tx=0x7fc068009040 comp rx=0 tx=0).stop 2023-09-29T23:08:37.589 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc075079700 1 -- 172.21.15.115:0/1581063302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc070143a30 msgr2=0x7fc070152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:37.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc075079700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc070143a30 0x7fc070152fb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc06000d860 tx=0x7fc060008040 comp rx=0 tx=0).stop 2023-09-29T23:08:37.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc075079700 1 -- 172.21.15.115:0/1581063302 shutdown_connections 2023-09-29T23:08:37.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc075079700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc05008e8b0 0x7fc050090d60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:37.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc075079700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc070143a30 0x7fc070152fb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:37.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc075079700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc070142e50 0x7fc0700a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:37.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc075079700 1 --2- 172.21.15.115:0/1581063302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc07009fc60 0x7fc0700adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:37.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc075079700 1 -- 172.21.15.115:0/1581063302 >> 172.21.15.115:0/1581063302 conn(0x7fc0700b6c10 msgr2=0x7fc0700b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:37.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc075079700 1 -- 172.21.15.115:0/1581063302 shutdown_connections 2023-09-29T23:08:37.590 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:37.584+0000 7fc075079700 1 -- 172.21.15.115:0/1581063302 wait complete. 2023-09-29T23:08:39.178 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:08:39.180 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:08:40.602 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:40.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.708+0000 7f15f6504700 1 Processor -- start 2023-09-29T23:08:40.714 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.708+0000 7f15f6504700 1 -- start start 2023-09-29T23:08:40.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f6504700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f15f0143270 0x7f15f01436d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:40.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f6504700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f00a4830 con 0x7f15f006e860 2023-09-29T23:08:40.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f6504700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f0067f30 con 0x7f15f0067b60 2023-09-29T23:08:40.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f6504700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f006fa30 con 0x7f15f0143270 2023-09-29T23:08:40.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f4d01700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f15f006e860 0x7f15f006ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49032/0 (socket says 172.21.15.115:49032) 2023-09-29T23:08:40.716 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f4d01700 1 -- 172.21.15.115:0/3180262315 learned_addr learned my addr 172.21.15.115:0/3180262315 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:08:40.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f5d03700 1 --2- 172.21.15.115:0/3180262315 >> v2:172.21.15.156:3300/0 conn(0x7f15f0143270 0x7f15f01436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:40.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15e7fff700 1 -- 172.21.15.115:0/3180262315 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646077656 0 0) 0x7f15f00a4830 con 0x7f15f006e860 2023-09-29T23:08:40.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15e7fff700 1 -- 172.21.15.115:0/3180262315 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15dc003570 con 0x7f15f006e860 2023-09-29T23:08:40.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f5d03700 1 -- 172.21.15.115:0/3180262315 >> v1:172.21.15.156:6789/0 conn(0x7f15f0067b60 legacy=0x7f15f00a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:40.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f5d03700 1 -- 172.21.15.115:0/3180262315 >> v1:172.21.15.115:6789/0 conn(0x7f15f006e860 legacy=0x7f15f006ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:40.717 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f5d03700 1 -- 172.21.15.115:0/3180262315 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f006e410 con 0x7f15f0143270 2023-09-29T23:08:40.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f5d03700 1 --2- 172.21.15.115:0/3180262315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f0143270 0x7f15f01436d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009e60 tx=0x7f15e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f9a9f9ee2613517 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:40.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15e7fff700 1 -- 172.21.15.115:0/3180262315 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e800e070 con 0x7f15f0143270 2023-09-29T23:08:40.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15e7fff700 1 -- 172.21.15.115:0/3180262315 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e800bb60 con 0x7f15f0143270 2023-09-29T23:08:40.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15e7fff700 1 -- 172.21.15.115:0/3180262315 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8012430 con 0x7f15f0143270 2023-09-29T23:08:40.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f6504700 1 -- 172.21.15.115:0/3180262315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f0143270 msgr2=0x7f15f01436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:40.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f6504700 1 --2- 172.21.15.115:0/3180262315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f0143270 0x7f15f01436d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009e60 tx=0x7f15e8009780 comp rx=0 tx=0).stop 2023-09-29T23:08:40.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f6504700 1 -- 172.21.15.115:0/3180262315 shutdown_connections 2023-09-29T23:08:40.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f6504700 1 --2- 172.21.15.115:0/3180262315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f0143270 0x7f15f01436d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:40.719 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f6504700 1 -- 172.21.15.115:0/3180262315 >> 172.21.15.115:0/3180262315 conn(0x7f15f0068a40 msgr2=0x7f15f0068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:40.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f6504700 1 -- 172.21.15.115:0/3180262315 shutdown_connections 2023-09-29T23:08:40.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.712+0000 7f15f6504700 1 -- 172.21.15.115:0/3180262315 wait complete. 2023-09-29T23:08:40.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f6504700 1 Processor -- start 2023-09-29T23:08:40.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f6504700 1 -- start start 2023-09-29T23:08:40.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f6504700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0067b60 0x7f15f009b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:40.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f6504700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15f006e860 0x7f15f00a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:40.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f6504700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f0143270 0x7f15f0133550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:40.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f6504700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00a5a70 con 0x7f15f0067b60 2023-09-29T23:08:40.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f6504700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f009ae00 con 0x7f15f0143270 2023-09-29T23:08:40.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f6504700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00a57e0 con 0x7f15f006e860 2023-09-29T23:08:40.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f4d01700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15f006e860 0x7f15f00a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:40.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f5502700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0067b60 0x7f15f009b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:40.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f5d03700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f0143270 0x7f15f0133550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:40.722 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f5d03700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f0143270 0x7f15f0133550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.115:40762/0 (socket says 172.21.15.115:40762) 2023-09-29T23:08:40.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f4d01700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15f006e860 0x7f15f00a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:48020/0 (socket says 172.21.15.115:48020) 2023-09-29T23:08:40.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f5d03700 1 -- 172.21.15.115:0/3320958910 learned_addr learned my addr 172.21.15.115:0/3320958910 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:40.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f5502700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0067b60 0x7f15f009b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57638/0 (socket says 172.21.15.115:57638) 2023-09-29T23:08:40.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f5502700 1 -- 172.21.15.115:0/3320958910 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15f006e860 msgr2=0x7f15f00a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:40.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f5502700 1 --2- 172.21.15.115:0/3320958910 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15f006e860 0x7f15f00a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:40.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f5502700 1 -- 172.21.15.115:0/3320958910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f0143270 msgr2=0x7f15f0133550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:40.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f5502700 1 --2- 172.21.15.115:0/3320958910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f0143270 0x7f15f0133550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:40.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f5502700 1 -- 172.21.15.115:0/3320958910 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8009a20 con 0x7f15f0067b60 2023-09-29T23:08:40.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f5502700 1 --2- 172.21.15.115:0/3320958910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0067b60 0x7f15f009b5e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00c590 tx=0x7f15ec007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:40.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15e57fa700 1 -- 172.21.15.115:0/3320958910 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec011590 con 0x7f15f0067b60 2023-09-29T23:08:40.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15e57fa700 1 -- 172.21.15.115:0/3320958910 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec011710 con 0x7f15f0067b60 2023-09-29T23:08:40.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f6504700 1 -- 172.21.15.115:0/3320958910 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f00a1e10 con 0x7f15f0067b60 2023-09-29T23:08:40.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15e57fa700 1 -- 172.21.15.115:0/3320958910 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec011ad0 con 0x7f15f0067b60 2023-09-29T23:08:40.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.716+0000 7f15f6504700 1 -- 172.21.15.115:0/3320958910 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f009bb20 con 0x7f15f0067b60 2023-09-29T23:08:40.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.720+0000 7f15f6504700 1 -- 172.21.15.115:0/3320958910 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f00a1290 con 0x7f15f0067b60 2023-09-29T23:08:40.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.720+0000 7f15e57fa700 1 -- 172.21.15.115:0/3320958910 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f15ec01b3b0 con 0x7f15f0067b60 2023-09-29T23:08:40.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.720+0000 7f15e57fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:40.726 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.724+0000 7f15e57fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:40.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.724+0000 7f15e57fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:40.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.724+0000 7f15e57fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:40.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.724+0000 7f15e57fa700 1 --2- 172.21.15.115:0/3320958910 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f15d408e830 0x7f15d4090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:40.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.724+0000 7f15e57fa700 1 -- 172.21.15.115:0/3320958910 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f15ec0b4100 con 0x7f15f0067b60 2023-09-29T23:08:40.727 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.724+0000 7f15f4d01700 1 --2- 172.21.15.115:0/3320958910 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f15d408e830 0x7f15d4090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:40.728 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.724+0000 7f15f4d01700 1 --2- 172.21.15.115:0/3320958910 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f15d408e830 0x7f15d4090ce0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15f00a2f10 tx=0x7f15e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:40.733 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.728+0000 7f15e57fa700 1 -- 172.21.15.115:0/3320958910 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f15ec084aa0 con 0x7f15f0067b60 2023-09-29T23:08:40.926 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.924+0000 7f15f6504700 1 -- 172.21.15.115:0/3320958910 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f15f004be00 con 0x7f15f0067b60 2023-09-29T23:08:40.929 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.924+0000 7f15e57fa700 1 -- 172.21.15.115:0/3320958910 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f15ec017080 con 0x7f15f0067b60 2023-09-29T23:08:40.929 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:40.929 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:40.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.928+0000 7f15f6504700 10 mgrc shutdown 2023-09-29T23:08:40.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.928+0000 7f15f6504700 1 -- 172.21.15.115:0/3320958910 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f15d408e830 msgr2=0x7f15d4090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:40.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.928+0000 7f15f6504700 1 --2- 172.21.15.115:0/3320958910 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f15d408e830 0x7f15d4090ce0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15f00a2f10 tx=0x7f15e0009040 comp rx=0 tx=0).stop 2023-09-29T23:08:40.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.928+0000 7f15f6504700 1 -- 172.21.15.115:0/3320958910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0067b60 msgr2=0x7f15f009b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:40.931 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.928+0000 7f15f6504700 1 --2- 172.21.15.115:0/3320958910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0067b60 0x7f15f009b5e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00c590 tx=0x7f15ec007ec0 comp rx=0 tx=0).stop 2023-09-29T23:08:40.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.928+0000 7f15f6504700 1 -- 172.21.15.115:0/3320958910 shutdown_connections 2023-09-29T23:08:40.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.928+0000 7f15f6504700 1 --2- 172.21.15.115:0/3320958910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15f0143270 0x7f15f0133550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:40.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.928+0000 7f15f6504700 1 --2- 172.21.15.115:0/3320958910 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15f006e860 0x7f15f00a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:40.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.928+0000 7f15f6504700 1 --2- 172.21.15.115:0/3320958910 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f15d408e830 0x7f15d4090ce0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:40.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.928+0000 7f15f6504700 1 --2- 172.21.15.115:0/3320958910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15f0067b60 0x7f15f009b5e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:40.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.928+0000 7f15f6504700 1 -- 172.21.15.115:0/3320958910 >> 172.21.15.115:0/3320958910 conn(0x7f15f0068a40 msgr2=0x7f15f0141820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:40.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.928+0000 7f15f6504700 1 -- 172.21.15.115:0/3320958910 shutdown_connections 2023-09-29T23:08:40.932 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:40.928+0000 7f15f6504700 1 -- 172.21.15.115:0/3320958910 wait complete. 2023-09-29T23:08:43.948 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:44.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f342a560700 1 Processor -- start 2023-09-29T23:08:44.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f342a560700 1 -- start start 2023-09-29T23:08:44.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f342a560700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f342406f460 0x7f34240680b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:44.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f342a560700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342409d5d0 0x7f342409d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:44.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f342a560700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f342409bbd0 0x7f342409c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:44.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f342a560700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342406f830 con 0x7f342406f460 2023-09-29T23:08:44.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f342a560700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342409c860 con 0x7f342409bbd0 2023-09-29T23:08:44.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f342a560700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342406c860 con 0x7f342409d5d0 2023-09-29T23:08:44.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f34237fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342409d5d0 0x7f342409d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:44.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f3423fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f342406f460 0x7f34240680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:44.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f34237fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342409d5d0 0x7f342409d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:48034/0 (socket says 172.21.15.115:48034) 2023-09-29T23:08:44.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f34237fe700 1 -- 172.21.15.115:0/3524620696 learned_addr learned my addr 172.21.15.115:0/3524620696 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:44.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f3428afd700 1 --2- 172.21.15.115:0/3524620696 >> v2:172.21.15.156:3300/0 conn(0x7f342409bbd0 0x7f342409c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:44.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f34237fe700 1 -- 172.21.15.115:0/3524620696 >> v2:172.21.15.156:3300/0 conn(0x7f342409bbd0 msgr2=0x7f342409c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:44.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f34237fe700 1 --2- 172.21.15.115:0/3524620696 >> v2:172.21.15.156:3300/0 conn(0x7f342409bbd0 0x7f342409c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:44.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f34237fe700 1 -- 172.21.15.115:0/3524620696 >> v2:172.21.15.115:3300/0 conn(0x7f342406f460 msgr2=0x7f34240680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:44.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f34237fe700 1 --2- 172.21.15.115:0/3524620696 >> v2:172.21.15.115:3300/0 conn(0x7f342406f460 0x7f34240680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:44.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f34237fe700 1 -- 172.21.15.115:0/3524620696 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342409c590 con 0x7f342409d5d0 2023-09-29T23:08:44.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f3423fff700 1 --2- 172.21.15.115:0/3524620696 >> v2:172.21.15.115:3300/0 conn(0x7f342406f460 0x7f34240680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:08:44.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.056+0000 7f34237fe700 1 --2- 172.21.15.115:0/3524620696 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342409d5d0 0x7f342409d9c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f34240a44e0 tx=0x7f3414009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d5765b43450ad6 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:44.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f3422ffd700 1 -- 172.21.15.115:0/3524620696 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400b6d0 con 0x7f342409d5d0 2023-09-29T23:08:44.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f3422ffd700 1 -- 172.21.15.115:0/3524620696 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341400b830 con 0x7f342409d5d0 2023-09-29T23:08:44.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f3422ffd700 1 -- 172.21.15.115:0/3524620696 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400bbf0 con 0x7f342409d5d0 2023-09-29T23:08:44.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f342a560700 1 -- 172.21.15.115:0/3524620696 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342409d5d0 msgr2=0x7f342409d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:44.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f342a560700 1 --2- 172.21.15.115:0/3524620696 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342409d5d0 0x7f342409d9c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f34240a44e0 tx=0x7f3414009250 comp rx=0 tx=0).stop 2023-09-29T23:08:44.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f342a560700 1 -- 172.21.15.115:0/3524620696 shutdown_connections 2023-09-29T23:08:44.064 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f342a560700 1 --2- 172.21.15.115:0/3524620696 >> v2:172.21.15.156:3300/0 conn(0x7f342409bbd0 0x7f342409c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:44.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f342a560700 1 --2- 172.21.15.115:0/3524620696 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342409d5d0 0x7f342409d9c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:44.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f342a560700 1 --2- 172.21.15.115:0/3524620696 >> v2:172.21.15.115:3300/0 conn(0x7f342406f460 0x7f34240680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:44.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f342a560700 1 -- 172.21.15.115:0/3524620696 >> 172.21.15.115:0/3524620696 conn(0x7f34240695c0 msgr2=0x7f34240699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:44.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f342a560700 1 -- 172.21.15.115:0/3524620696 shutdown_connections 2023-09-29T23:08:44.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f342a560700 1 -- 172.21.15.115:0/3524620696 wait complete. 2023-09-29T23:08:44.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f342a560700 1 Processor -- start 2023-09-29T23:08:44.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.060+0000 7f342a560700 1 -- start start 2023-09-29T23:08:44.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f342a560700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342406f460 0x7f34241435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:44.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f342a560700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f342409bbd0 0x7f342413c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:44.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f342a560700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342409d5d0 0x7f342413ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:44.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f342a560700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34240a1180 con 0x7f342409d5d0 2023-09-29T23:08:44.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f342a560700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34240a0cf0 con 0x7f342409bbd0 2023-09-29T23:08:44.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f342a560700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34240a15a0 con 0x7f342406f460 2023-09-29T23:08:44.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f3423fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342406f460 0x7f34241435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:44.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f3428afd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342409d5d0 0x7f342413ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:44.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f3423fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342406f460 0x7f34241435f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:48038/0 (socket says 172.21.15.115:48038) 2023-09-29T23:08:44.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f3423fff700 1 -- 172.21.15.115:0/1131030474 learned_addr learned my addr 172.21.15.115:0/1131030474 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:44.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f34237fe700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f342409bbd0 0x7f342413c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:44.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f3428afd700 1 -- 172.21.15.115:0/1131030474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342406f460 msgr2=0x7f34241435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:44.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f3428afd700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342406f460 0x7f34241435f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:44.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f3428afd700 1 -- 172.21.15.115:0/1131030474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f342409bbd0 msgr2=0x7f342413c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:44.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f3428afd700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f342409bbd0 0x7f342413c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:44.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f3428afd700 1 -- 172.21.15.115:0/1131030474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3418009420 con 0x7f342409d5d0 2023-09-29T23:08:44.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f34237fe700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f342409bbd0 0x7f342413c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:08:44.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f3423fff700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342406f460 0x7f34241435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:08:44.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f3428afd700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342409d5d0 0x7f342413ce00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f341c009e50 tx=0x7f341c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:44.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f340bfff700 1 -- 172.21.15.115:0/1131030474 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c00ca40 con 0x7f342409d5d0 2023-09-29T23:08:44.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f340bfff700 1 -- 172.21.15.115:0/1131030474 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c00f040 con 0x7f342409d5d0 2023-09-29T23:08:44.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f342a560700 1 -- 172.21.15.115:0/1131030474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34140094f0 con 0x7f342409d5d0 2023-09-29T23:08:44.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f340bfff700 1 -- 172.21.15.115:0/1131030474 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c00cdf0 con 0x7f342409d5d0 2023-09-29T23:08:44.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.064+0000 7f342a560700 1 -- 172.21.15.115:0/1131030474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342413d750 con 0x7f342409d5d0 2023-09-29T23:08:44.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.068+0000 7f342a560700 1 -- 172.21.15.115:0/1131030474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34240a0e60 con 0x7f342409d5d0 2023-09-29T23:08:44.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.068+0000 7f340bfff700 1 -- 172.21.15.115:0/1131030474 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f341c014690 con 0x7f342409d5d0 2023-09-29T23:08:44.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.068+0000 7f340bfff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:44.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.068+0000 7f340bfff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:44.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.068+0000 7f340bfff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:44.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.068+0000 7f340bfff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:44.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.068+0000 7f340bfff700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f341008e8b0 0x7f3410090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:44.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.072+0000 7f340bfff700 1 -- 172.21.15.115:0/1131030474 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f341c0b5410 con 0x7f342409d5d0 2023-09-29T23:08:44.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.072+0000 7f3423fff700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f341008e8b0 0x7f3410090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:44.075 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.072+0000 7f3423fff700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f341008e8b0 0x7f3410090d60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3418011640 tx=0x7f34180091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:44.080 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.076+0000 7f340bfff700 1 -- 172.21.15.115:0/1131030474 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f341c089840 con 0x7f342409d5d0 2023-09-29T23:08:44.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.272+0000 7f342a560700 1 -- 172.21.15.115:0/1131030474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3424070990 con 0x7f342409d5d0 2023-09-29T23:08:44.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.272+0000 7f340bfff700 1 -- 172.21.15.115:0/1131030474 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f341c018080 con 0x7f342409d5d0 2023-09-29T23:08:44.277 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:44.277 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:44.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.276+0000 7f342a560700 10 mgrc shutdown 2023-09-29T23:08:44.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.276+0000 7f342a560700 1 -- 172.21.15.115:0/1131030474 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f341008e8b0 msgr2=0x7f3410090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:44.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.276+0000 7f342a560700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f341008e8b0 0x7f3410090d60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3418011640 tx=0x7f34180091a0 comp rx=0 tx=0).stop 2023-09-29T23:08:44.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.276+0000 7f342a560700 1 -- 172.21.15.115:0/1131030474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342409d5d0 msgr2=0x7f342413ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:44.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.276+0000 7f342a560700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342409d5d0 0x7f342413ce00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f341c009e50 tx=0x7f341c00b040 comp rx=0 tx=0).stop 2023-09-29T23:08:44.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.276+0000 7f342a560700 1 -- 172.21.15.115:0/1131030474 shutdown_connections 2023-09-29T23:08:44.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.276+0000 7f342a560700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f341008e8b0 0x7f3410090d60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:44.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.276+0000 7f342a560700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342409d5d0 0x7f342413ce00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:44.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.276+0000 7f342a560700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f342409bbd0 0x7f342413c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:44.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.276+0000 7f342a560700 1 --2- 172.21.15.115:0/1131030474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342406f460 0x7f34241435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:44.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.276+0000 7f342a560700 1 -- 172.21.15.115:0/1131030474 >> 172.21.15.115:0/1131030474 conn(0x7f34240695c0 msgr2=0x7f342409aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:44.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.276+0000 7f342a560700 1 -- 172.21.15.115:0/1131030474 shutdown_connections 2023-09-29T23:08:44.281 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:44.276+0000 7f342a560700 1 -- 172.21.15.115:0/1131030474 wait complete. 2023-09-29T23:08:47.293 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:47.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 Processor -- start 2023-09-29T23:08:47.403 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 -- start start 2023-09-29T23:08:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f08100a4140 0x7f08100670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0810068130 0x7f081009da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100675e0 con 0x7f081009d680 2023-09-29T23:08:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100a3710 con 0x7f0810068130 2023-09-29T23:08:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081009bd40 con 0x7f08100a4140 2023-09-29T23:08:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f080f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f081009d680 0x7f0810067a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:53988/0 (socket says 172.21.15.115:53988) 2023-09-29T23:08:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f080f7fe700 1 -- 172.21.15.115:0/401174632 learned_addr learned my addr 172.21.15.115:0/401174632 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:08:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f0814b79700 1 --2- 172.21.15.115:0/401174632 >> v2:172.21.15.115:3300/0 conn(0x7f0810068130 0x7f081009da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f080ffff700 1 --2- 172.21.15.115:0/401174632 >> v2:172.21.15.156:3300/0 conn(0x7f08100a4140 0x7f08100670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f080effd700 1 -- 172.21.15.115:0/401174632 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793426450 0 0) 0x7f0808001490 con 0x7f081009d680 2023-09-29T23:08:47.405 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f080effd700 1 -- 172.21.15.115:0/401174632 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07fc003570 con 0x7f081009d680 2023-09-29T23:08:47.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f0814b79700 1 -- 172.21.15.115:0/401174632 >> v2:172.21.15.156:3300/0 conn(0x7f08100a4140 msgr2=0x7f08100670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:47.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f0814b79700 1 --2- 172.21.15.115:0/401174632 >> v2:172.21.15.156:3300/0 conn(0x7f08100a4140 0x7f08100670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:47.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f0814b79700 1 -- 172.21.15.115:0/401174632 >> v1:172.21.15.115:6789/0 conn(0x7f081009d680 legacy=0x7f0810067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:47.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f0814b79700 1 -- 172.21.15.115:0/401174632 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08100a4510 con 0x7f0810068130 2023-09-29T23:08:47.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f080ffff700 1 --2- 172.21.15.115:0/401174632 >> v2:172.21.15.156:3300/0 conn(0x7f08100a4140 0x7f08100670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:08:47.406 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f0814b79700 1 --2- 172.21.15.115:0/401174632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0810068130 0x7f081009da80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f081006a840 tx=0x7f08000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79842edbc46906f server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:47.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f080effd700 1 -- 172.21.15.115:0/401174632 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800011630 con 0x7f0810068130 2023-09-29T23:08:47.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f080effd700 1 -- 172.21.15.115:0/401174632 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08000117b0 con 0x7f0810068130 2023-09-29T23:08:47.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f080effd700 1 -- 172.21.15.115:0/401174632 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800011b70 con 0x7f0810068130 2023-09-29T23:08:47.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 -- 172.21.15.115:0/401174632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0810068130 msgr2=0x7f081009da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:47.407 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 --2- 172.21.15.115:0/401174632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0810068130 0x7f081009da80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f081006a840 tx=0x7f08000091a0 comp rx=0 tx=0).stop 2023-09-29T23:08:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 -- 172.21.15.115:0/401174632 shutdown_connections 2023-09-29T23:08:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 --2- 172.21.15.115:0/401174632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0810068130 0x7f081009da80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 --2- 172.21.15.115:0/401174632 >> v2:172.21.15.156:3300/0 conn(0x7f08100a4140 0x7f08100670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 -- 172.21.15.115:0/401174632 >> 172.21.15.115:0/401174632 conn(0x7f08100b1d20 msgr2=0x7f08100b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 -- 172.21.15.115:0/401174632 shutdown_connections 2023-09-29T23:08:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.400+0000 7f081537a700 1 -- 172.21.15.115:0/401174632 wait complete. 2023-09-29T23:08:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f081537a700 1 Processor -- start 2023-09-29T23:08:47.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f081537a700 1 -- start start 2023-09-29T23:08:47.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f081537a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0810068130 0x7f081006e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:47.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f081537a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f081009d680 0x7f08101487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:47.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f081537a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100a4140 0x7f0810148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:47.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f081537a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810157d40 con 0x7f08100a4140 2023-09-29T23:08:47.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f081537a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810157a80 con 0x7f0810068130 2023-09-29T23:08:47.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f081537a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0810098550 con 0x7f081009d680 2023-09-29T23:08:47.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f0814b79700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100a4140 0x7f0810148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:47.410 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f0814b79700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100a4140 0x7f0810148cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45390/0 (socket says 172.21.15.115:45390) 2023-09-29T23:08:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f0814b79700 1 -- 172.21.15.115:0/459304235 learned_addr learned my addr 172.21.15.115:0/459304235 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f080f7fe700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f081009d680 0x7f08101487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f080ffff700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0810068130 0x7f081006e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f080f7fe700 1 -- 172.21.15.115:0/459304235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0810068130 msgr2=0x7f081006e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f080f7fe700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0810068130 0x7f081006e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f080f7fe700 1 -- 172.21.15.115:0/459304235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100a4140 msgr2=0x7f0810148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f080f7fe700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100a4140 0x7f0810148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f080f7fe700 1 -- 172.21.15.115:0/459304235 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f8009420 con 0x7f081009d680 2023-09-29T23:08:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f080f7fe700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f081009d680 0x7f08101487b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0808005c50 tx=0x7f0808001a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f0807fff700 1 -- 172.21.15.115:0/459304235 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080800a7e0 con 0x7f081009d680 2023-09-29T23:08:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f0807fff700 1 -- 172.21.15.115:0/459304235 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080800a940 con 0x7f081009d680 2023-09-29T23:08:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f081537a700 1 -- 172.21.15.115:0/459304235 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0800009420 con 0x7f081009d680 2023-09-29T23:08:47.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f0807fff700 1 -- 172.21.15.115:0/459304235 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080800ace0 con 0x7f081009d680 2023-09-29T23:08:47.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.404+0000 7f081537a700 1 -- 172.21.15.115:0/459304235 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0810099260 con 0x7f081009d680 2023-09-29T23:08:47.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.408+0000 7f081537a700 1 -- 172.21.15.115:0/459304235 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0810099680 con 0x7f081009d680 2023-09-29T23:08:47.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.408+0000 7f0807fff700 1 -- 172.21.15.115:0/459304235 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f0808007300 con 0x7f081009d680 2023-09-29T23:08:47.413 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.408+0000 7f0807fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:47.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.412+0000 7f0807fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:47.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.412+0000 7f0807fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:47.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.412+0000 7f0807fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:47.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.412+0000 7f0807fff700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f07f008e830 0x7f07f0090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:47.415 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.412+0000 7f0807fff700 1 -- 172.21.15.115:0/459304235 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f08080b4aa0 con 0x7f081009d680 2023-09-29T23:08:47.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.412+0000 7f080ffff700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f07f008e830 0x7f07f0090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:47.416 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.412+0000 7f080ffff700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f07f008e830 0x7f07f0090ce0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009ea0 tx=0x7f07f80091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:47.422 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.416+0000 7f0807fff700 1 -- 172.21.15.115:0/459304235 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0810099680 con 0x7f081009d680 2023-09-29T23:08:47.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.608+0000 7f081537a700 1 -- 172.21.15.115:0/459304235 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f08100675e0 con 0x7f081009d680 2023-09-29T23:08:47.614 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.612+0000 7f0807fff700 1 -- 172.21.15.115:0/459304235 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f08100675e0 con 0x7f081009d680 2023-09-29T23:08:47.615 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:47.615 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:47.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.612+0000 7f081537a700 10 mgrc shutdown 2023-09-29T23:08:47.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.616+0000 7f081537a700 1 -- 172.21.15.115:0/459304235 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f07f008e830 msgr2=0x7f07f0090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:47.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.616+0000 7f081537a700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f07f008e830 0x7f07f0090ce0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009ea0 tx=0x7f07f80091a0 comp rx=0 tx=0).stop 2023-09-29T23:08:47.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.616+0000 7f081537a700 1 -- 172.21.15.115:0/459304235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f081009d680 msgr2=0x7f08101487b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:47.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.616+0000 7f081537a700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f081009d680 0x7f08101487b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0808005c50 tx=0x7f0808001a90 comp rx=0 tx=0).stop 2023-09-29T23:08:47.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.616+0000 7f081537a700 1 -- 172.21.15.115:0/459304235 shutdown_connections 2023-09-29T23:08:47.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.616+0000 7f081537a700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f07f008e830 0x7f07f0090ce0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:47.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.616+0000 7f081537a700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08100a4140 0x7f0810148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:47.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.616+0000 7f081537a700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f081009d680 0x7f08101487b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:47.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.616+0000 7f081537a700 1 --2- 172.21.15.115:0/459304235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0810068130 0x7f081006e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:47.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.616+0000 7f081537a700 1 -- 172.21.15.115:0/459304235 >> 172.21.15.115:0/459304235 conn(0x7f08100b1d20 msgr2=0x7f0810069260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:47.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.616+0000 7f081537a700 1 -- 172.21.15.115:0/459304235 shutdown_connections 2023-09-29T23:08:47.620 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:47.616+0000 7f081537a700 1 -- 172.21.15.115:0/459304235 wait complete. 2023-09-29T23:08:50.633 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:50.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 Processor -- start 2023-09-29T23:08:50.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 -- start start 2023-09-29T23:08:50.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fad24067b60 0x7fad2409d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:50.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240a4120 0x7fad2409bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:50.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2409ce00 con 0x7fad2413fb10 2023-09-29T23:08:50.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad24067f30 con 0x7fad24067b60 2023-09-29T23:08:50.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2409d970 con 0x7fad240a4120 2023-09-29T23:08:50.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad227fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240a4120 0x7fad2409bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:50.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad227fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240a4120 0x7fad2409bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:36214/0 (socket says 172.21.15.115:36214) 2023-09-29T23:08:50.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad227fc700 1 -- 172.21.15.115:0/951510131 learned_addr learned my addr 172.21.15.115:0/951510131 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:50.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad22ffd700 1 --2- 172.21.15.115:0/951510131 >> v2:172.21.15.115:3300/0 conn(0x7fad24067b60 0x7fad2409d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:50.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad227fc700 1 -- 172.21.15.115:0/951510131 >> v2:172.21.15.115:3300/0 conn(0x7fad24067b60 msgr2=0x7fad2409d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:50.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad227fc700 1 --2- 172.21.15.115:0/951510131 >> v2:172.21.15.115:3300/0 conn(0x7fad24067b60 0x7fad2409d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:50.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad227fc700 1 -- 172.21.15.115:0/951510131 >> v1:172.21.15.156:6789/0 conn(0x7fad2413fb10 legacy=0x7fad240a21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:50.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad227fc700 1 -- 172.21.15.115:0/951510131 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2409dc10 con 0x7fad240a4120 2023-09-29T23:08:50.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad227fc700 1 --2- 172.21.15.115:0/951510131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240a4120 0x7fad2409bf20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad140099b0 tx=0x7fad14009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82eb5728c5a33d0a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:50.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad21ffb700 1 -- 172.21.15.115:0/951510131 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14009ea0 con 0x7fad240a4120 2023-09-29T23:08:50.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad21ffb700 1 -- 172.21.15.115:0/951510131 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1400b860 con 0x7fad240a4120 2023-09-29T23:08:50.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad21ffb700 1 -- 172.21.15.115:0/951510131 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1400bc00 con 0x7fad240a4120 2023-09-29T23:08:50.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 -- 172.21.15.115:0/951510131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240a4120 msgr2=0x7fad2409bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:50.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 --2- 172.21.15.115:0/951510131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240a4120 0x7fad2409bf20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad140099b0 tx=0x7fad14009250 comp rx=0 tx=0).stop 2023-09-29T23:08:50.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 -- 172.21.15.115:0/951510131 shutdown_connections 2023-09-29T23:08:50.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 --2- 172.21.15.115:0/951510131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240a4120 0x7fad2409bf20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:50.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 --2- 172.21.15.115:0/951510131 >> v2:172.21.15.115:3300/0 conn(0x7fad24067b60 0x7fad2409d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:50.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 -- 172.21.15.115:0/951510131 >> 172.21.15.115:0/951510131 conn(0x7fad240b1d20 msgr2=0x7fad240b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:50.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 -- 172.21.15.115:0/951510131 shutdown_connections 2023-09-29T23:08:50.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.744+0000 7fad23fff700 1 -- 172.21.15.115:0/951510131 wait complete. 2023-09-29T23:08:50.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad23fff700 1 Processor -- start 2023-09-29T23:08:50.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad23fff700 1 -- start start 2023-09-29T23:08:50.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad23fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad24067b60 0x7fad241401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:50.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad23fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad240a4120 0x7fad24096ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:50.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad23fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad2413fb10 0x7fad240983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:50.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad23fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2409a000 con 0x7fad2413fb10 2023-09-29T23:08:50.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad23fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad24097f30 con 0x7fad240a4120 2023-09-29T23:08:50.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad23fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2413f5a0 con 0x7fad24067b60 2023-09-29T23:08:50.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad22ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad24067b60 0x7fad241401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:50.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad237fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad2413fb10 0x7fad240983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:50.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad237fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad2413fb10 0x7fad240983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45414/0 (socket says 172.21.15.115:45414) 2023-09-29T23:08:50.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad237fe700 1 -- 172.21.15.115:0/704517803 learned_addr learned my addr 172.21.15.115:0/704517803 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:50.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad22ffd700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad24067b60 0x7fad241401a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:36218/0 (socket says 172.21.15.115:36218) 2023-09-29T23:08:50.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad227fc700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad240a4120 0x7fad24096ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad237fe700 1 -- 172.21.15.115:0/704517803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad24067b60 msgr2=0x7fad241401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad237fe700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad24067b60 0x7fad241401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad237fe700 1 -- 172.21.15.115:0/704517803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad240a4120 msgr2=0x7fad24096ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad237fe700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad240a4120 0x7fad24096ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad237fe700 1 -- 172.21.15.115:0/704517803 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad140094f0 con 0x7fad2413fb10 2023-09-29T23:08:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad237fe700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad2413fb10 0x7fad240983f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00c810 tx=0x7fad1c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad0affd700 1 -- 172.21.15.115:0/704517803 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c012630 con 0x7fad2413fb10 2023-09-29T23:08:50.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad0affd700 1 -- 172.21.15.115:0/704517803 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c012790 con 0x7fad2413fb10 2023-09-29T23:08:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.748+0000 7fad23fff700 1 -- 172.21.15.115:0/704517803 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad24099080 con 0x7fad2413fb10 2023-09-29T23:08:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.752+0000 7fad0affd700 1 -- 172.21.15.115:0/704517803 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c012b50 con 0x7fad2413fb10 2023-09-29T23:08:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.752+0000 7fad23fff700 1 -- 172.21.15.115:0/704517803 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad24098930 con 0x7fad2413fb10 2023-09-29T23:08:50.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.752+0000 7fad23fff700 1 -- 172.21.15.115:0/704517803 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad240980f0 con 0x7fad2413fb10 2023-09-29T23:08:50.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.752+0000 7fad0affd700 1 -- 172.21.15.115:0/704517803 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fad1c01b400 con 0x7fad2413fb10 2023-09-29T23:08:50.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.752+0000 7fad0affd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:50.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.756+0000 7fad0affd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:50.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.756+0000 7fad0affd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:50.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.756+0000 7fad0affd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:50.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.756+0000 7fad0affd700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fad1008e930 0x7fad10090de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:50.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.756+0000 7fad0affd700 1 -- 172.21.15.115:0/704517803 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fad1c0b4a10 con 0x7fad2413fb10 2023-09-29T23:08:50.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.756+0000 7fad22ffd700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fad1008e930 0x7fad10090de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:50.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.756+0000 7fad22ffd700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fad1008e930 0x7fad10090de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad18009db0 tx=0x7fad180091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:50.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.760+0000 7fad0affd700 1 -- 172.21.15.115:0/704517803 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fad1c0853a0 con 0x7fad2413fb10 2023-09-29T23:08:50.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 1 -- 172.21.15.115:0/704517803 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fad2404be00 con 0x7fad2413fb10 2023-09-29T23:08:50.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad0affd700 1 -- 172.21.15.115:0/704517803 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fad1c016100 con 0x7fad2413fb10 2023-09-29T23:08:50.964 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:50.964 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:50.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 10 mgrc shutdown 2023-09-29T23:08:50.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 1 -- 172.21.15.115:0/704517803 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fad1008e930 msgr2=0x7fad10090de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:50.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fad1008e930 0x7fad10090de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad18009db0 tx=0x7fad180091a0 comp rx=0 tx=0).stop 2023-09-29T23:08:50.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 1 -- 172.21.15.115:0/704517803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad2413fb10 msgr2=0x7fad240983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:50.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad2413fb10 0x7fad240983f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00c810 tx=0x7fad1c001670 comp rx=0 tx=0).stop 2023-09-29T23:08:50.966 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 1 -- 172.21.15.115:0/704517803 shutdown_connections 2023-09-29T23:08:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fad1008e930 0x7fad10090de0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad2413fb10 0x7fad240983f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad240a4120 0x7fad24096ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 1 --2- 172.21.15.115:0/704517803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad24067b60 0x7fad241401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 1 -- 172.21.15.115:0/704517803 >> 172.21.15.115:0/704517803 conn(0x7fad240b1d20 msgr2=0x7fad2409f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 1 -- 172.21.15.115:0/704517803 shutdown_connections 2023-09-29T23:08:50.967 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:50.960+0000 7fad23fff700 1 -- 172.21.15.115:0/704517803 wait complete. 2023-09-29T23:08:53.979 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:54.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.084+0000 7f501b59e700 1 Processor -- start 2023-09-29T23:08:54.090 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.084+0000 7f501b59e700 1 -- start start 2023-09-29T23:08:54.091 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501b59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f501c0a32d0 0x7f501c09e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:54.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501b59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f501c0a36a0 0x7f501c09c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:54.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501b59e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501c13fd50 con 0x7f501c0a0f50 2023-09-29T23:08:54.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501b59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c13fff0 con 0x7f501c0a36a0 2023-09-29T23:08:54.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501b59e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c140290 con 0x7f501c0a32d0 2023-09-29T23:08:54.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f5013fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f501c0a36a0 0x7f501c09c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:54.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f5013fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f501c0a36a0 0x7f501c09c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45424/0 (socket says 172.21.15.115:45424) 2023-09-29T23:08:54.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f5013fff700 1 -- 172.21.15.115:0/1981193449 learned_addr learned my addr 172.21.15.115:0/1981193449 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:54.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501a59c700 1 --2- 172.21.15.115:0/1981193449 >> v2:172.21.15.156:3300/0 conn(0x7f501c0a32d0 0x7f501c09e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:54.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f5013fff700 1 -- 172.21.15.115:0/1981193449 >> v2:172.21.15.156:3300/0 conn(0x7f501c0a32d0 msgr2=0x7f501c09e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:54.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f5013fff700 1 --2- 172.21.15.115:0/1981193449 >> v2:172.21.15.156:3300/0 conn(0x7f501c0a32d0 0x7f501c09e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:54.092 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f5013fff700 1 -- 172.21.15.115:0/1981193449 >> v1:172.21.15.115:6789/0 conn(0x7f501c0a0f50 legacy=0x7f501c0670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:54.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f5013fff700 1 -- 172.21.15.115:0/1981193449 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c09dbf0 con 0x7f501c0a36a0 2023-09-29T23:08:54.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f5013fff700 1 --2- 172.21.15.115:0/1981193449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c0a36a0 0x7f501c09c920 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f500c0099b0 tx=0x7f500c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672cc921bde2078 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:54.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f5019d9b700 1 -- 172.21.15.115:0/1981193449 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c00b820 con 0x7f501c0a36a0 2023-09-29T23:08:54.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f5019d9b700 1 -- 172.21.15.115:0/1981193449 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c00b980 con 0x7f501c0a36a0 2023-09-29T23:08:54.093 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f5019d9b700 1 -- 172.21.15.115:0/1981193449 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c00bd20 con 0x7f501c0a36a0 2023-09-29T23:08:54.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501b59e700 1 -- 172.21.15.115:0/1981193449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c0a36a0 msgr2=0x7f501c09c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:54.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501b59e700 1 --2- 172.21.15.115:0/1981193449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c0a36a0 0x7f501c09c920 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f500c0099b0 tx=0x7f500c009250 comp rx=0 tx=0).stop 2023-09-29T23:08:54.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501b59e700 1 -- 172.21.15.115:0/1981193449 shutdown_connections 2023-09-29T23:08:54.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501b59e700 1 --2- 172.21.15.115:0/1981193449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c0a36a0 0x7f501c09c920 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:54.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501b59e700 1 --2- 172.21.15.115:0/1981193449 >> v2:172.21.15.156:3300/0 conn(0x7f501c0a32d0 0x7f501c09e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:54.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501b59e700 1 -- 172.21.15.115:0/1981193449 >> 172.21.15.115:0/1981193449 conn(0x7f501c0b1d20 msgr2=0x7f501c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:54.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501b59e700 1 -- 172.21.15.115:0/1981193449 shutdown_connections 2023-09-29T23:08:54.094 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.088+0000 7f501b59e700 1 -- 172.21.15.115:0/1981193449 wait complete. 2023-09-29T23:08:54.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501b59e700 1 Processor -- start 2023-09-29T23:08:54.095 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501b59e700 1 -- start start 2023-09-29T23:08:54.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501b59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c0a0f50 0x7f501c0a23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:54.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501b59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f501c0a32d0 0x7f501c06d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:54.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501b59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0a36a0 0x7f501c150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:54.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501b59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c0981b0 con 0x7f501c0a0f50 2023-09-29T23:08:54.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501b59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c098e70 con 0x7f501c0a32d0 2023-09-29T23:08:54.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501b59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c06df50 con 0x7f501c0a36a0 2023-09-29T23:08:54.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501ad9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0a36a0 0x7f501c150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:54.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501ad9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0a36a0 0x7f501c150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:36226/0 (socket says 172.21.15.115:36226) 2023-09-29T23:08:54.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501ad9d700 1 -- 172.21.15.115:0/1875712534 learned_addr learned my addr 172.21.15.115:0/1875712534 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:54.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501a59c700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c0a0f50 0x7f501c0a23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:54.097 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f5013fff700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f501c0a32d0 0x7f501c06d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:54.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501ad9d700 1 -- 172.21.15.115:0/1875712534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f501c0a32d0 msgr2=0x7f501c06d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:54.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501ad9d700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f501c0a32d0 0x7f501c06d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:54.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501ad9d700 1 -- 172.21.15.115:0/1875712534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c0a0f50 msgr2=0x7f501c0a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:54.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501ad9d700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c0a0f50 0x7f501c0a23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:54.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501ad9d700 1 -- 172.21.15.115:0/1875712534 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c0094f0 con 0x7f501c0a36a0 2023-09-29T23:08:54.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501ad9d700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0a36a0 0x7f501c150930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f501400c840 tx=0x7f5014001670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:54.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f50127fc700 1 -- 172.21.15.115:0/1875712534 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014012630 con 0x7f501c0a36a0 2023-09-29T23:08:54.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f50127fc700 1 -- 172.21.15.115:0/1875712534 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50140127b0 con 0x7f501c0a36a0 2023-09-29T23:08:54.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501b59e700 1 -- 172.21.15.115:0/1875712534 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501c06e210 con 0x7f501c0a36a0 2023-09-29T23:08:54.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f50127fc700 1 -- 172.21.15.115:0/1875712534 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014012b70 con 0x7f501c0a36a0 2023-09-29T23:08:54.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.092+0000 7f501b59e700 1 -- 172.21.15.115:0/1875712534 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501c0a2b40 con 0x7f501c0a36a0 2023-09-29T23:08:54.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.096+0000 7f501b59e700 1 -- 172.21.15.115:0/1875712534 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501c04be00 con 0x7f501c0a36a0 2023-09-29T23:08:54.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.096+0000 7f50127fc700 1 -- 172.21.15.115:0/1875712534 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f5014003030 con 0x7f501c0a36a0 2023-09-29T23:08:54.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.096+0000 7f50127fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:54.102 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.100+0000 7f50127fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:54.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.100+0000 7f50127fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:54.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.100+0000 7f50127fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:54.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.100+0000 7f50127fc700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4ffc08e860 0x7f4ffc090d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:54.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.100+0000 7f50127fc700 1 -- 172.21.15.115:0/1875712534 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f50140b4fc0 con 0x7f501c0a36a0 2023-09-29T23:08:54.103 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.100+0000 7f501a59c700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4ffc08e860 0x7f4ffc090d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:54.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.100+0000 7f501a59c700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4ffc08e860 0x7f4ffc090d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5004006fd0 tx=0x7f5004008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:54.106 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.104+0000 7f50127fc700 1 -- 172.21.15.115:0/1875712534 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5014085960 con 0x7f501c0a36a0 2023-09-29T23:08:54.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.292+0000 7f501b59e700 1 -- 172.21.15.115:0/1875712534 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f501c098fe0 con 0x7f501c0a36a0 2023-09-29T23:08:54.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.292+0000 7f50127fc700 1 -- 172.21.15.115:0/1875712534 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f5014088f80 con 0x7f501c0a36a0 2023-09-29T23:08:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:54.298 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:54.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.296+0000 7f501b59e700 10 mgrc shutdown 2023-09-29T23:08:54.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.296+0000 7f501b59e700 1 -- 172.21.15.115:0/1875712534 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4ffc08e860 msgr2=0x7f4ffc090d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:54.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.296+0000 7f501b59e700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4ffc08e860 0x7f4ffc090d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5004006fd0 tx=0x7f5004008040 comp rx=0 tx=0).stop 2023-09-29T23:08:54.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.296+0000 7f501b59e700 1 -- 172.21.15.115:0/1875712534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0a36a0 msgr2=0x7f501c150930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:54.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.296+0000 7f501b59e700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0a36a0 0x7f501c150930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f501400c840 tx=0x7f5014001670 comp rx=0 tx=0).stop 2023-09-29T23:08:54.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.296+0000 7f501b59e700 1 -- 172.21.15.115:0/1875712534 shutdown_connections 2023-09-29T23:08:54.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.296+0000 7f501b59e700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f501c0a36a0 0x7f501c150930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:54.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.296+0000 7f501b59e700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f501c0a32d0 0x7f501c06d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:54.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.296+0000 7f501b59e700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f4ffc08e860 0x7f4ffc090d10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:54.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.296+0000 7f501b59e700 1 --2- 172.21.15.115:0/1875712534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f501c0a0f50 0x7f501c0a23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:54.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.296+0000 7f501b59e700 1 -- 172.21.15.115:0/1875712534 >> 172.21.15.115:0/1875712534 conn(0x7f501c0b1d20 msgr2=0x7f501c069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:54.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.296+0000 7f501b59e700 1 -- 172.21.15.115:0/1875712534 shutdown_connections 2023-09-29T23:08:54.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:54.296+0000 7f501b59e700 1 -- 172.21.15.115:0/1875712534 wait complete. 2023-09-29T23:08:57.317 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:08:57.428 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031ed74700 1 Processor -- start 2023-09-29T23:08:57.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031ed74700 1 -- start start 2023-09-29T23:08:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031ed74700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0318067b60 0x7f031809d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031ed74700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f03180a4120 0x7f031809bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031ed74700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031809ce00 con 0x7f031813fb10 2023-09-29T23:08:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031ed74700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0318067f30 con 0x7f0318067b60 2023-09-29T23:08:57.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031ed74700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f031809d970 con 0x7f03180a4120 2023-09-29T23:08:57.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031dd72700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0318067b60 0x7f031809d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:57.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031e573700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f031813fb10 0x7f03180a21c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40974/0 (socket says 172.21.15.115:40974) 2023-09-29T23:08:57.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031e573700 1 -- 172.21.15.115:0/1148944387 learned_addr learned my addr 172.21.15.115:0/1148944387 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:08:57.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031d571700 1 --2- 172.21.15.115:0/1148944387 >> v2:172.21.15.156:3300/0 conn(0x7f03180a4120 0x7f031809bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:57.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031dd72700 1 -- 172.21.15.115:0/1148944387 >> v2:172.21.15.156:3300/0 conn(0x7f03180a4120 msgr2=0x7f031809bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:08:57.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031dd72700 1 --2- 172.21.15.115:0/1148944387 >> v2:172.21.15.156:3300/0 conn(0x7f03180a4120 0x7f031809bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:57.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031dd72700 1 -- 172.21.15.115:0/1148944387 >> v1:172.21.15.115:6789/0 conn(0x7f031813fb10 legacy=0x7f03180a21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:57.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.424+0000 7f031dd72700 1 -- 172.21.15.115:0/1148944387 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031809dc10 con 0x7f0318067b60 2023-09-29T23:08:57.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.428+0000 7f031dd72700 1 --2- 172.21.15.115:0/1148944387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0318067b60 0x7f031809d320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f031809cf90 tx=0x7f0310009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fd9e16a5368151 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:57.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.428+0000 7f031cd70700 1 -- 172.21.15.115:0/1148944387 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0310016070 con 0x7f0318067b60 2023-09-29T23:08:57.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.428+0000 7f031cd70700 1 -- 172.21.15.115:0/1148944387 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031000bb30 con 0x7f0318067b60 2023-09-29T23:08:57.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.428+0000 7f031cd70700 1 -- 172.21.15.115:0/1148944387 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031000e070 con 0x7f0318067b60 2023-09-29T23:08:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.428+0000 7f031ed74700 1 -- 172.21.15.115:0/1148944387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0318067b60 msgr2=0x7f031809d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.428+0000 7f031ed74700 1 --2- 172.21.15.115:0/1148944387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0318067b60 0x7f031809d320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f031809cf90 tx=0x7f0310009780 comp rx=0 tx=0).stop 2023-09-29T23:08:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.428+0000 7f031ed74700 1 -- 172.21.15.115:0/1148944387 shutdown_connections 2023-09-29T23:08:57.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.428+0000 7f031ed74700 1 --2- 172.21.15.115:0/1148944387 >> v2:172.21.15.156:3300/0 conn(0x7f03180a4120 0x7f031809bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.428+0000 7f031ed74700 1 --2- 172.21.15.115:0/1148944387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0318067b60 0x7f031809d320 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.428+0000 7f031ed74700 1 -- 172.21.15.115:0/1148944387 >> 172.21.15.115:0/1148944387 conn(0x7f03180b1d20 msgr2=0x7f03180b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.428+0000 7f031ed74700 1 -- 172.21.15.115:0/1148944387 shutdown_connections 2023-09-29T23:08:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.428+0000 7f031ed74700 1 -- 172.21.15.115:0/1148944387 wait complete. 2023-09-29T23:08:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031ed74700 1 Processor -- start 2023-09-29T23:08:57.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031ed74700 1 -- start start 2023-09-29T23:08:57.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031ed74700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0318067b60 0x7f0318098310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:57.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031ed74700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03180a4120 0x7f03180997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:57.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031ed74700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f031813fb10 0x7f0318099d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:57.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031ed74700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031813ded0 con 0x7f03180a4120 2023-09-29T23:08:57.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031ed74700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03180979c0 con 0x7f0318067b60 2023-09-29T23:08:57.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031ed74700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031809abf0 con 0x7f031813fb10 2023-09-29T23:08:57.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031e573700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f031813fb10 0x7f0318099d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:57.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031d571700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03180a4120 0x7f03180997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:57.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031e573700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f031813fb10 0x7f0318099d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52158/0 (socket says 172.21.15.115:52158) 2023-09-29T23:08:57.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031e573700 1 -- 172.21.15.115:0/1484251381 learned_addr learned my addr 172.21.15.115:0/1484251381 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:08:57.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031d571700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03180a4120 0x7f03180997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39958/0 (socket says 172.21.15.115:39958) 2023-09-29T23:08:57.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031dd72700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0318067b60 0x7f0318098310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:57.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031e573700 1 -- 172.21.15.115:0/1484251381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0318067b60 msgr2=0x7f0318098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:57.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031e573700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0318067b60 0x7f0318098310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:57.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031e573700 1 -- 172.21.15.115:0/1484251381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03180a4120 msgr2=0x7f03180997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:57.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031e573700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03180a4120 0x7f03180997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:57.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031e573700 1 -- 172.21.15.115:0/1484251381 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0310009a20 con 0x7f031813fb10 2023-09-29T23:08:57.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031e573700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f031813fb10 0x7f0318099d20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f031400c560 tx=0x7f0314007f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:57.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f030dffb700 1 -- 172.21.15.115:0/1484251381 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314005b30 con 0x7f031813fb10 2023-09-29T23:08:57.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f030dffb700 1 -- 172.21.15.115:0/1484251381 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0314005c90 con 0x7f031813fb10 2023-09-29T23:08:57.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f030dffb700 1 -- 172.21.15.115:0/1484251381 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140072e0 con 0x7f031813fb10 2023-09-29T23:08:57.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031ed74700 1 -- 172.21.15.115:0/1484251381 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0318095760 con 0x7f031813fb10 2023-09-29T23:08:57.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.432+0000 7f031ed74700 1 -- 172.21.15.115:0/1484251381 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0318094a90 con 0x7f031813fb10 2023-09-29T23:08:57.443 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.436+0000 7f031ed74700 1 -- 172.21.15.115:0/1484251381 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031804be00 con 0x7f031813fb10 2023-09-29T23:08:57.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.436+0000 7f030dffb700 1 -- 172.21.15.115:0/1484251381 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f0314007690 con 0x7f031813fb10 2023-09-29T23:08:57.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.436+0000 7f030dffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:08:57.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.436+0000 7f030dffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:08:57.444 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.436+0000 7f030dffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:57.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.436+0000 7f030dffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:08:57.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.436+0000 7f030dffb700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f02fc08e8b0 0x7f02fc090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:08:57.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.440+0000 7f030dffb700 1 -- 172.21.15.115:0/1484251381 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f03140b3ad0 con 0x7f031813fb10 2023-09-29T23:08:57.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.440+0000 7f031dd72700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f02fc08e8b0 0x7f02fc090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:08:57.445 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.440+0000 7f031dd72700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f02fc08e8b0 0x7f02fc090d60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f03100097c0 tx=0x7f0310018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:08:57.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.444+0000 7f030dffb700 1 -- 172.21.15.115:0/1484251381 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0314049be0 con 0x7f031813fb10 2023-09-29T23:08:57.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.640+0000 7f031ed74700 1 -- 172.21.15.115:0/1484251381 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f03180a44f0 con 0x7f031813fb10 2023-09-29T23:08:57.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.640+0000 7f030dffb700 1 -- 172.21.15.115:0/1484251381 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f0314017020 con 0x7f031813fb10 2023-09-29T23:08:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:08:57.645 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:08:57.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.644+0000 7f031ed74700 10 mgrc shutdown 2023-09-29T23:08:57.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.644+0000 7f031ed74700 1 -- 172.21.15.115:0/1484251381 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f02fc08e8b0 msgr2=0x7f02fc090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:57.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.644+0000 7f031ed74700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f02fc08e8b0 0x7f02fc090d60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f03100097c0 tx=0x7f0310018000 comp rx=0 tx=0).stop 2023-09-29T23:08:57.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.644+0000 7f031ed74700 1 -- 172.21.15.115:0/1484251381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f031813fb10 msgr2=0x7f0318099d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:08:57.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.644+0000 7f031ed74700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f031813fb10 0x7f0318099d20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f031400c560 tx=0x7f0314007f60 comp rx=0 tx=0).stop 2023-09-29T23:08:57.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.644+0000 7f031ed74700 1 -- 172.21.15.115:0/1484251381 shutdown_connections 2023-09-29T23:08:57.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.644+0000 7f031ed74700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f031813fb10 0x7f0318099d20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:57.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.644+0000 7f031ed74700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f02fc08e8b0 0x7f02fc090d60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:57.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.644+0000 7f031ed74700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03180a4120 0x7f03180997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:57.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.644+0000 7f031ed74700 1 --2- 172.21.15.115:0/1484251381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0318067b60 0x7f0318098310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:08:57.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.644+0000 7f031ed74700 1 -- 172.21.15.115:0/1484251381 >> 172.21.15.115:0/1484251381 conn(0x7f03180b1d20 msgr2=0x7f031809ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:08:57.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.644+0000 7f031ed74700 1 -- 172.21.15.115:0/1484251381 shutdown_connections 2023-09-29T23:08:57.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:08:57.644+0000 7f031ed74700 1 -- 172.21.15.115:0/1484251381 wait complete. 2023-09-29T23:09:00.661 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:00.769 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.764+0000 7fc7988d9700 1 Processor -- start 2023-09-29T23:09:00.770 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.764+0000 7fc7988d9700 1 -- start start 2023-09-29T23:09:00.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.764+0000 7fc7988d9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc79406c190 0x7fc7940a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:00.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.764+0000 7fc7988d9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc7940a4b30 0x7fc794069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:00.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.764+0000 7fc7988d9700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7940a5010 con 0x7fc79406bdc0 2023-09-29T23:09:00.772 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.764+0000 7fc7988d9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc794140590 con 0x7fc79406c190 2023-09-29T23:09:00.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.764+0000 7fc7988d9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc794140850 con 0x7fc7940a4b30 2023-09-29T23:09:00.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.764+0000 7fc791d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc79406c190 0x7fc7940a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:00.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc791d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc79406c190 0x7fc7940a65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39962/0 (socket says 172.21.15.115:39962) 2023-09-29T23:09:00.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc791d9b700 1 -- 172.21.15.115:0/2263294815 learned_addr learned my addr 172.21.15.115:0/2263294815 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:00.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc792d9d700 1 --2- 172.21.15.115:0/2263294815 >> v2:172.21.15.156:3300/0 conn(0x7fc7940a4b30 0x7fc794069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:00.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc791d9b700 1 -- 172.21.15.115:0/2263294815 >> v2:172.21.15.156:3300/0 conn(0x7fc7940a4b30 msgr2=0x7fc794069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:00.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc791d9b700 1 --2- 172.21.15.115:0/2263294815 >> v2:172.21.15.156:3300/0 conn(0x7fc7940a4b30 0x7fc794069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:00.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc791d9b700 1 -- 172.21.15.115:0/2263294815 >> v1:172.21.15.156:6789/0 conn(0x7fc79406bdc0 legacy=0x7fc79413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc791d9b700 1 -- 172.21.15.115:0/2263294815 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc794140b10 con 0x7fc79406c190 2023-09-29T23:09:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc791d9b700 1 --2- 172.21.15.115:0/2263294815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79406c190 0x7fc7940a65f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc79406ac00 tx=0x7fc784009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de84e80c5537717 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc79159a700 1 -- 172.21.15.115:0/2263294815 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78400b820 con 0x7fc79406c190 2023-09-29T23:09:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc79159a700 1 -- 172.21.15.115:0/2263294815 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78400b980 con 0x7fc79406c190 2023-09-29T23:09:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc79159a700 1 -- 172.21.15.115:0/2263294815 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78400bd20 con 0x7fc79406c190 2023-09-29T23:09:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 -- 172.21.15.115:0/2263294815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79406c190 msgr2=0x7fc7940a65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 --2- 172.21.15.115:0/2263294815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79406c190 0x7fc7940a65f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc79406ac00 tx=0x7fc784009250 comp rx=0 tx=0).stop 2023-09-29T23:09:00.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 -- 172.21.15.115:0/2263294815 shutdown_connections 2023-09-29T23:09:00.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 --2- 172.21.15.115:0/2263294815 >> v2:172.21.15.156:3300/0 conn(0x7fc7940a4b30 0x7fc794069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:00.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 --2- 172.21.15.115:0/2263294815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79406c190 0x7fc7940a65f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:00.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 -- 172.21.15.115:0/2263294815 >> 172.21.15.115:0/2263294815 conn(0x7fc7940b4bc0 msgr2=0x7fc79406b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:00.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 -- 172.21.15.115:0/2263294815 shutdown_connections 2023-09-29T23:09:00.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 -- 172.21.15.115:0/2263294815 wait complete. 2023-09-29T23:09:00.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 Processor -- start 2023-09-29T23:09:00.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 -- start start 2023-09-29T23:09:00.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc79406bdc0 0x7fc794143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:00.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79406c190 0x7fc79409e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:00.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7940a4b30 0x7fc79409ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:00.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79409f170 con 0x7fc79406c190 2023-09-29T23:09:00.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc794143130 con 0x7fc79406bdc0 2023-09-29T23:09:00.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.768+0000 7fc7988d9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc794141210 con 0x7fc7940a4b30 2023-09-29T23:09:00.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc792d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7940a4b30 0x7fc79409ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:00.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc792d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7940a4b30 0x7fc79409ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52162/0 (socket says 172.21.15.115:52162) 2023-09-29T23:09:00.779 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc792d9d700 1 -- 172.21.15.115:0/3385171447 learned_addr learned my addr 172.21.15.115:0/3385171447 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:00.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc791d9b700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79406c190 0x7fc79409e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:00.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc79259c700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc79406bdc0 0x7fc794143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:00.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc792d9d700 1 -- 172.21.15.115:0/3385171447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc79406bdc0 msgr2=0x7fc794143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:00.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc792d9d700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc79406bdc0 0x7fc794143af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:00.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc792d9d700 1 -- 172.21.15.115:0/3385171447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79406c190 msgr2=0x7fc79409e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:00.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc792d9d700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79406c190 0x7fc79409e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:00.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc792d9d700 1 -- 172.21.15.115:0/3385171447 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840094f0 con 0x7fc7940a4b30 2023-09-29T23:09:00.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc792d9d700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7940a4b30 0x7fc79409ec30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc78c009fd0 tx=0x7fc78c009900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:00.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc7827fc700 1 -- 172.21.15.115:0/3385171447 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c00ebf0 con 0x7fc7940a4b30 2023-09-29T23:09:00.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc7827fc700 1 -- 172.21.15.115:0/3385171447 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c00ed50 con 0x7fc7940a4b30 2023-09-29T23:09:00.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc7988d9700 1 -- 172.21.15.115:0/3385171447 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79409f380 con 0x7fc7940a4b30 2023-09-29T23:09:00.780 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc7827fc700 1 -- 172.21.15.115:0/3385171447 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c014670 con 0x7fc7940a4b30 2023-09-29T23:09:00.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc7988d9700 1 -- 172.21.15.115:0/3385171447 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc794144030 con 0x7fc7940a4b30 2023-09-29T23:09:00.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.772+0000 7fc7988d9700 1 -- 172.21.15.115:0/3385171447 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79409e410 con 0x7fc7940a4b30 2023-09-29T23:09:00.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.776+0000 7fc7827fc700 1 -- 172.21.15.115:0/3385171447 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc78c0149e0 con 0x7fc7940a4b30 2023-09-29T23:09:00.781 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.776+0000 7fc7827fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:00.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.776+0000 7fc7827fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:00.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.776+0000 7fc7827fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:00.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.776+0000 7fc7827fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:00.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.776+0000 7fc7827fc700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc77408e8e0 0x7fc774090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:00.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.780+0000 7fc7827fc700 1 -- 172.21.15.115:0/3385171447 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fc78c0b5c20 con 0x7fc7940a4b30 2023-09-29T23:09:00.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.780+0000 7fc79259c700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc77408e8e0 0x7fc774090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:00.784 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.780+0000 7fc79259c700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc77408e8e0 0x7fc774090d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc788009af0 tx=0x7fc788009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:00.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.784+0000 7fc7827fc700 1 -- 172.21.15.115:0/3385171447 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc78c0865c0 con 0x7fc7940a4b30 2023-09-29T23:09:00.982 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 1 -- 172.21.15.115:0/3385171447 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc79409e410 con 0x7fc7940a4b30 2023-09-29T23:09:00.983 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7827fc700 1 -- 172.21.15.115:0/3385171447 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fc79409e410 con 0x7fc7940a4b30 2023-09-29T23:09:00.983 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:00.983 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:00.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 10 mgrc shutdown 2023-09-29T23:09:00.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 1 -- 172.21.15.115:0/3385171447 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc77408e8e0 msgr2=0x7fc774090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:00.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc77408e8e0 0x7fc774090d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc788009af0 tx=0x7fc788009060 comp rx=0 tx=0).stop 2023-09-29T23:09:00.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 1 -- 172.21.15.115:0/3385171447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7940a4b30 msgr2=0x7fc79409ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:00.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7940a4b30 0x7fc79409ec30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc78c009fd0 tx=0x7fc78c009900 comp rx=0 tx=0).stop 2023-09-29T23:09:00.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 1 -- 172.21.15.115:0/3385171447 shutdown_connections 2023-09-29T23:09:00.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7940a4b30 0x7fc79409ec30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:00.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc77408e8e0 0x7fc774090d90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:00.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc79406c190 0x7fc79409e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:00.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 1 --2- 172.21.15.115:0/3385171447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc79406bdc0 0x7fc794143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:00.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 1 -- 172.21.15.115:0/3385171447 >> 172.21.15.115:0/3385171447 conn(0x7fc7940b4bc0 msgr2=0x7fc79409d180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:00.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 1 -- 172.21.15.115:0/3385171447 shutdown_connections 2023-09-29T23:09:00.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:00.980+0000 7fc7988d9700 1 -- 172.21.15.115:0/3385171447 wait complete. 2023-09-29T23:09:03.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:04.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f659847d700 1 Processor -- start 2023-09-29T23:09:04.107 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f659847d700 1 -- start start 2023-09-29T23:09:04.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f659847d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f65900a69d0 0x7f65900a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:04.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f659847d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65900a2390 con 0x7f659013f070 2023-09-29T23:09:04.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f659847d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65900a6da0 con 0x7f65900674a0 2023-09-29T23:09:04.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f659847d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65900a07c0 con 0x7f65900a69d0 2023-09-29T23:09:04.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6596a1a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f659013f070 0x7f659013f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40990/0 (socket says 172.21.15.115:40990) 2023-09-29T23:09:04.109 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6596a1a700 1 -- 172.21.15.115:0/1730151414 learned_addr learned my addr 172.21.15.115:0/1730151414 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:09:04.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572930089 0 0) 0x7f65900a2390 con 0x7f659013f070 2023-09-29T23:09:04.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f657c003570 con 0x7f659013f070 2023-09-29T23:09:04.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6596219700 1 --2- 172.21.15.115:0/1730151414 >> v2:172.21.15.156:3300/0 conn(0x7f65900a69d0 0x7f65900a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:04.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3941073180 0 0) 0x7f657c003570 con 0x7f659013f070 2023-09-29T23:09:04.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 >> v2:172.21.15.156:3300/0 conn(0x7f65900a69d0 msgr2=0x7f65900a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:04.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 --2- 172.21.15.115:0/1730151414 >> v2:172.21.15.156:3300/0 conn(0x7f65900a69d0 0x7f65900a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:04.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 >> v1:172.21.15.156:6789/0 conn(0x7f65900674a0 legacy=0x7f65900a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:04.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65900a1de0 con 0x7f659013f070 2023-09-29T23:09:04.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3987234196 0 0) 0x7f6580001490 con 0x7f659013f070 2023-09-29T23:09:04.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 >> v1:172.21.15.115:6789/0 conn(0x7f659013f070 legacy=0x7f659013f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:04.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 --2- 172.21.15.115:0/1730151414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f657c003a60 0x7f657c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:04.110 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 --2- 172.21.15.115:0/1730151414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f657c004810 0x7f657c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:04.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 --2- 172.21.15.115:0/1730151414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f657c005230 0x7f657c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:04.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c00c130 con 0x7f657c005230 2023-09-29T23:09:04.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c00c2a0 con 0x7f657c003a60 2023-09-29T23:09:04.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657c00c460 con 0x7f657c004810 2023-09-29T23:09:04.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6596a1a700 1 --2- 172.21.15.115:0/1730151414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f657c005230 0x7f657c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:04.111 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6596219700 1 --2- 172.21.15.115:0/1730151414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f657c003a60 0x7f657c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:04.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6596a1a700 1 -- 172.21.15.115:0/1730151414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f657c004810 msgr2=0x7f657c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:04.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595a18700 1 --2- 172.21.15.115:0/1730151414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f657c004810 0x7f657c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:04.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6596a1a700 1 --2- 172.21.15.115:0/1730151414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f657c004810 0x7f657c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:04.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6596a1a700 1 -- 172.21.15.115:0/1730151414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f657c003a60 msgr2=0x7f657c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:04.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6596a1a700 1 --2- 172.21.15.115:0/1730151414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f657c003a60 0x7f657c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:04.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6596a1a700 1 -- 172.21.15.115:0/1730151414 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c003570 con 0x7f657c005230 2023-09-29T23:09:04.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6595a18700 1 --2- 172.21.15.115:0/1730151414 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f657c004810 0x7f657c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:09:04.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6596a1a700 1 -- 172.21.15.115:0/1730151414 reap_dead start 2023-09-29T23:09:04.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.104+0000 7f6596a1a700 1 --2- 172.21.15.115:0/1730151414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f657c005230 0x7f657c00ba60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f658000c390 tx=0x7f65900a12d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96f1c4695999efd server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:04.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.108+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000cc60 con 0x7f657c005230 2023-09-29T23:09:04.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.108+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658000cdc0 con 0x7f657c005230 2023-09-29T23:09:04.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.108+0000 7f6595217700 1 -- 172.21.15.115:0/1730151414 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580004b20 con 0x7f657c005230 2023-09-29T23:09:04.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.108+0000 7f659847d700 1 -- 172.21.15.115:0/1730151414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f657c005230 msgr2=0x7f657c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:04.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.108+0000 7f659847d700 1 --2- 172.21.15.115:0/1730151414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f657c005230 0x7f657c00ba60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f658000c390 tx=0x7f65900a12d0 comp rx=0 tx=0).stop 2023-09-29T23:09:04.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.108+0000 7f659847d700 1 -- 172.21.15.115:0/1730151414 shutdown_connections 2023-09-29T23:09:04.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.108+0000 7f659847d700 1 --2- 172.21.15.115:0/1730151414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f657c005230 0x7f657c00ba60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:04.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.108+0000 7f659847d700 1 -- 172.21.15.115:0/1730151414 >> 172.21.15.115:0/1730151414 conn(0x7f6590085f90 msgr2=0x7f65900a8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:04.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.108+0000 7f659847d700 1 -- 172.21.15.115:0/1730151414 shutdown_connections 2023-09-29T23:09:04.114 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.108+0000 7f659847d700 1 -- 172.21.15.115:0/1730151414 wait complete. 2023-09-29T23:09:04.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.108+0000 7f659847d700 1 Processor -- start 2023-09-29T23:09:04.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.108+0000 7f659847d700 1 -- start start 2023-09-29T23:09:04.115 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f659847d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f657c005230 0x7f65901438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:04.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f659847d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6590143e10 0x7f65900979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:04.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f659847d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6590145bf0 0x7f6590097f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:04.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f659847d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590098450 con 0x7f6590145bf0 2023-09-29T23:09:04.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f659847d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590144800 con 0x7f6590143e10 2023-09-29T23:09:04.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f659847d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65901442a0 con 0x7f657c005230 2023-09-29T23:09:04.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f6596219700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f657c005230 0x7f65901438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:04.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f6596219700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f657c005230 0x7f65901438d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52172/0 (socket says 172.21.15.115:52172) 2023-09-29T23:09:04.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f6596219700 1 -- 172.21.15.115:0/2861361056 learned_addr learned my addr 172.21.15.115:0/2861361056 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:04.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f6596a1a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6590145bf0 0x7f6590097f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:04.116 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f6595a18700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6590143e10 0x7f65900979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:04.117 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f6596a1a700 1 -- 172.21.15.115:0/2861361056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f657c005230 msgr2=0x7f65901438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:04.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f6596a1a700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f657c005230 0x7f65901438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:04.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f6596a1a700 1 -- 172.21.15.115:0/2861361056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6590143e10 msgr2=0x7f65900979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:04.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f6596a1a700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6590143e10 0x7f65900979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:04.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f6596a1a700 1 -- 172.21.15.115:0/2861361056 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6590144540 con 0x7f6590145bf0 2023-09-29T23:09:04.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f6596219700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f657c005230 0x7f65901438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:09:04.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f6596a1a700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6590145bf0 0x7f6590097f10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f65900a6370 tx=0x7f6580015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:04.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f658e7fc700 1 -- 172.21.15.115:0/2861361056 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658001d070 con 0x7f6590145bf0 2023-09-29T23:09:04.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f658e7fc700 1 -- 172.21.15.115:0/2861361056 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6580004e90 con 0x7f6590145bf0 2023-09-29T23:09:04.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f659847d700 1 -- 172.21.15.115:0/2861361056 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6590144f40 con 0x7f6590145bf0 2023-09-29T23:09:04.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f658e7fc700 1 -- 172.21.15.115:0/2861361056 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000cc60 con 0x7f6590145bf0 2023-09-29T23:09:04.118 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.112+0000 7f659847d700 1 -- 172.21.15.115:0/2861361056 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659013ce20 con 0x7f6590145bf0 2023-09-29T23:09:04.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.116+0000 7f658e7fc700 1 -- 172.21.15.115:0/2861361056 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f65800148a0 con 0x7f6590145bf0 2023-09-29T23:09:04.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.116+0000 7f658e7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:04.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.116+0000 7f659847d700 1 -- 172.21.15.115:0/2861361056 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65900a2760 con 0x7f6590145bf0 2023-09-29T23:09:04.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.116+0000 7f658e7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:04.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.116+0000 7f658e7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:04.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.116+0000 7f658e7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:04.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.116+0000 7f658e7fc700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f657008e8b0 0x7f6570090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:04.121 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.116+0000 7f658e7fc700 1 -- 172.21.15.115:0/2861361056 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f65800b4820 con 0x7f6590145bf0 2023-09-29T23:09:04.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.116+0000 7f6596219700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f657008e8b0 0x7f6570090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:04.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.116+0000 7f6596219700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f657008e8b0 0x7f6570090d60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6588009fd0 tx=0x7f6588009760 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:04.128 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.124+0000 7f658e7fc700 1 -- 172.21.15.115:0/2861361056 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f65900a2760 con 0x7f6590145bf0 2023-09-29T23:09:04.323 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f659847d700 1 -- 172.21.15.115:0/2861361056 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f65900a2760 con 0x7f6590145bf0 2023-09-29T23:09:04.324 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f658e7fc700 1 -- 172.21.15.115:0/2861361056 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f65900a2760 con 0x7f6590145bf0 2023-09-29T23:09:04.324 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:04.324 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:04.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f659847d700 10 mgrc shutdown 2023-09-29T23:09:04.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f659847d700 1 -- 172.21.15.115:0/2861361056 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f657008e8b0 msgr2=0x7f6570090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:04.326 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f659847d700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f657008e8b0 0x7f6570090d60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6588009fd0 tx=0x7f6588009760 comp rx=0 tx=0).stop 2023-09-29T23:09:04.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f659847d700 1 -- 172.21.15.115:0/2861361056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6590145bf0 msgr2=0x7f6590097f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:04.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f659847d700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6590145bf0 0x7f6590097f10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f65900a6370 tx=0x7f6580015000 comp rx=0 tx=0).stop 2023-09-29T23:09:04.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f659847d700 1 -- 172.21.15.115:0/2861361056 shutdown_connections 2023-09-29T23:09:04.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f659847d700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f657008e8b0 0x7f6570090d60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:04.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f659847d700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6590145bf0 0x7f6590097f10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:04.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f659847d700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6590143e10 0x7f65900979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:04.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f659847d700 1 --2- 172.21.15.115:0/2861361056 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f657c005230 0x7f65901438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:04.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f659847d700 1 -- 172.21.15.115:0/2861361056 >> 172.21.15.115:0/2861361056 conn(0x7f6590085f90 msgr2=0x7f65900a42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:04.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.320+0000 7f659847d700 1 -- 172.21.15.115:0/2861361056 shutdown_connections 2023-09-29T23:09:04.327 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:04.324+0000 7f659847d700 1 -- 172.21.15.115:0/2861361056 wait complete. 2023-09-29T23:09:07.339 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:07.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 Processor -- start 2023-09-29T23:09:07.451 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 -- start start 2023-09-29T23:09:07.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3c009d9e0 0x7fb3c0140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:07.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb3c013d700 0x7fb3c009f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:07.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c013e770 con 0x7fb3c009ddb0 2023-09-29T23:09:07.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c0141d20 con 0x7fb3c009d9e0 2023-09-29T23:09:07.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c013dc00 con 0x7fb3c013d700 2023-09-29T23:09:07.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c4f42700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3c009d9e0 0x7fb3c0140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:07.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3bffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fb3c009ddb0 0x7fb3c0141610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56494/0 (socket says 172.21.15.115:56494) 2023-09-29T23:09:07.452 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3bffff700 1 -- 172.21.15.115:0/3119529259 learned_addr learned my addr 172.21.15.115:0/3119529259 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:09:07.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5743700 1 --2- 172.21.15.115:0/3119529259 >> v2:172.21.15.156:3300/0 conn(0x7fb3c013d700 0x7fb3c009f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:07.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3bf7fe700 1 -- 172.21.15.115:0/3119529259 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590934712 0 0) 0x7fb3c013e770 con 0x7fb3c009ddb0 2023-09-29T23:09:07.453 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3bf7fe700 1 -- 172.21.15.115:0/3119529259 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3b0003570 con 0x7fb3c009ddb0 2023-09-29T23:09:07.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c4f42700 1 -- 172.21.15.115:0/3119529259 >> v2:172.21.15.156:3300/0 conn(0x7fb3c013d700 msgr2=0x7fb3c009f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:07.454 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3bf7fe700 1 -- 172.21.15.115:0/3119529259 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2350942604 0 0) 0x7fb3b0003570 con 0x7fb3c009ddb0 2023-09-29T23:09:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c4f42700 1 --2- 172.21.15.115:0/3119529259 >> v2:172.21.15.156:3300/0 conn(0x7fb3c013d700 0x7fb3c009f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c4f42700 1 -- 172.21.15.115:0/3119529259 >> v1:172.21.15.115:6789/0 conn(0x7fb3c009ddb0 legacy=0x7fb3c0141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c4f42700 1 -- 172.21.15.115:0/3119529259 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c013dec0 con 0x7fb3c009d9e0 2023-09-29T23:09:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5743700 1 --2- 172.21.15.115:0/3119529259 >> v2:172.21.15.156:3300/0 conn(0x7fb3c013d700 0x7fb3c009f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:09:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c4f42700 1 --2- 172.21.15.115:0/3119529259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c009d9e0 0x7fb3c0140d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb3c009ef50 tx=0x7fb3b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783138ecee5d7f0a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3bf7fe700 1 -- 172.21.15.115:0/3119529259 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac001470 con 0x7fb3c009d9e0 2023-09-29T23:09:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3bf7fe700 1 -- 172.21.15.115:0/3119529259 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b4011420 con 0x7fb3c009d9e0 2023-09-29T23:09:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3bf7fe700 1 -- 172.21.15.115:0/3119529259 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40117c0 con 0x7fb3c009d9e0 2023-09-29T23:09:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3119529259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c009d9e0 msgr2=0x7fb3c0140d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 --2- 172.21.15.115:0/3119529259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c009d9e0 0x7fb3c0140d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb3c009ef50 tx=0x7fb3b40091a0 comp rx=0 tx=0).stop 2023-09-29T23:09:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3119529259 shutdown_connections 2023-09-29T23:09:07.455 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 --2- 172.21.15.115:0/3119529259 >> v2:172.21.15.156:3300/0 conn(0x7fb3c013d700 0x7fb3c009f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 --2- 172.21.15.115:0/3119529259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c009d9e0 0x7fb3c0140d50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3119529259 >> 172.21.15.115:0/3119529259 conn(0x7fb3c00b1d20 msgr2=0x7fb3c00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3119529259 shutdown_connections 2023-09-29T23:09:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.448+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3119529259 wait complete. 2023-09-29T23:09:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3c5f44700 1 Processor -- start 2023-09-29T23:09:07.456 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3c5f44700 1 -- start start 2023-09-29T23:09:07.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3c5f44700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3c009d9e0 0x7fb3c00994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:07.457 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3c5f44700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3c009ddb0 0x7fb3c0098000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3c5f44700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c013d700 0x7fb3c0098540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3c5f44700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c009a140 con 0x7fb3c013d700 2023-09-29T23:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3c5f44700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0141fe0 con 0x7fb3c009d9e0 2023-09-29T23:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3c5f44700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0099e80 con 0x7fb3c009ddb0 2023-09-29T23:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3bffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3c009ddb0 0x7fb3c0098000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3c5743700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c013d700 0x7fb3c0098540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3bffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3c009ddb0 0x7fb3c0098000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:33282/0 (socket says 172.21.15.115:33282) 2023-09-29T23:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3bffff700 1 -- 172.21.15.115:0/3814498746 learned_addr learned my addr 172.21.15.115:0/3814498746 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:07.458 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3c4f42700 1 --2- 172.21.15.115:0/3814498746 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3c009d9e0 0x7fb3c00994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:07.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3bffff700 1 -- 172.21.15.115:0/3814498746 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3c009d9e0 msgr2=0x7fb3c00994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:07.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3bffff700 1 --2- 172.21.15.115:0/3814498746 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3c009d9e0 0x7fb3c00994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:07.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3bffff700 1 -- 172.21.15.115:0/3814498746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c013d700 msgr2=0x7fb3c0098540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:07.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3bffff700 1 --2- 172.21.15.115:0/3814498746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c013d700 0x7fb3c0098540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:07.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.452+0000 7fb3bffff700 1 -- 172.21.15.115:0/3814498746 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b8009a20 con 0x7fb3c009ddb0 2023-09-29T23:09:07.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.456+0000 7fb3bffff700 1 --2- 172.21.15.115:0/3814498746 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3c009ddb0 0x7fb3c0098000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00cbf0 tx=0x7fb3ac001ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:07.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.456+0000 7fb3bcff9700 1 -- 172.21.15.115:0/3814498746 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac007150 con 0x7fb3c009ddb0 2023-09-29T23:09:07.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.456+0000 7fb3bcff9700 1 -- 172.21.15.115:0/3814498746 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac0072d0 con 0x7fb3c009ddb0 2023-09-29T23:09:07.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.456+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3814498746 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b4009420 con 0x7fb3c009ddb0 2023-09-29T23:09:07.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.456+0000 7fb3bcff9700 1 -- 172.21.15.115:0/3814498746 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac007690 con 0x7fb3c009ddb0 2023-09-29T23:09:07.460 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.456+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3814498746 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c00999f0 con 0x7fb3c009ddb0 2023-09-29T23:09:07.461 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.456+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3814498746 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c004be00 con 0x7fb3c009ddb0 2023-09-29T23:09:07.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.460+0000 7fb3bcff9700 1 -- 172.21.15.115:0/3814498746 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fb3ac004a40 con 0x7fb3c009ddb0 2023-09-29T23:09:07.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.460+0000 7fb3bcff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:07.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.460+0000 7fb3bcff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:07.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.460+0000 7fb3bcff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:07.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.460+0000 7fb3bcff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:07.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.460+0000 7fb3bcff9700 1 --2- 172.21.15.115:0/3814498746 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb3a408e830 0x7fb3a4090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:07.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.460+0000 7fb3bcff9700 1 -- 172.21.15.115:0/3814498746 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fb3ac0b3cd0 con 0x7fb3c009ddb0 2023-09-29T23:09:07.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.460+0000 7fb3c4f42700 1 --2- 172.21.15.115:0/3814498746 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb3a408e830 0x7fb3a4090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:07.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.460+0000 7fb3c4f42700 1 --2- 172.21.15.115:0/3814498746 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb3a408e830 0x7fb3a4090ce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb3c009ef50 tx=0x7fb3b4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:07.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.468+0000 7fb3bcff9700 1 -- 172.21.15.115:0/3814498746 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb3ac084660 con 0x7fb3c009ddb0 2023-09-29T23:09:07.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.668+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3814498746 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb3c00a3700 con 0x7fb3c009ddb0 2023-09-29T23:09:07.673 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.668+0000 7fb3bcff9700 1 -- 172.21.15.115:0/3814498746 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fb3ac018020 con 0x7fb3c009ddb0 2023-09-29T23:09:07.673 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:07.673 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:07.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.672+0000 7fb3c5f44700 10 mgrc shutdown 2023-09-29T23:09:07.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.672+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3814498746 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb3a408e830 msgr2=0x7fb3a4090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:07.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.672+0000 7fb3c5f44700 1 --2- 172.21.15.115:0/3814498746 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb3a408e830 0x7fb3a4090ce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb3c009ef50 tx=0x7fb3b4016000 comp rx=0 tx=0).stop 2023-09-29T23:09:07.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.672+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3814498746 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3c009ddb0 msgr2=0x7fb3c0098000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:07.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.672+0000 7fb3c5f44700 1 --2- 172.21.15.115:0/3814498746 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3c009ddb0 0x7fb3c0098000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00cbf0 tx=0x7fb3ac001ad0 comp rx=0 tx=0).stop 2023-09-29T23:09:07.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.672+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3814498746 shutdown_connections 2023-09-29T23:09:07.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.672+0000 7fb3c5f44700 1 --2- 172.21.15.115:0/3814498746 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fb3a408e830 0x7fb3a4090ce0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:07.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.672+0000 7fb3c5f44700 1 --2- 172.21.15.115:0/3814498746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3c013d700 0x7fb3c0098540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:07.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.672+0000 7fb3c5f44700 1 --2- 172.21.15.115:0/3814498746 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3c009ddb0 0x7fb3c0098000 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:07.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.672+0000 7fb3c5f44700 1 --2- 172.21.15.115:0/3814498746 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3c009d9e0 0x7fb3c00994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:07.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.672+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3814498746 >> 172.21.15.115:0/3814498746 conn(0x7fb3c00b1d20 msgr2=0x7fb3c00a1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:07.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.672+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3814498746 shutdown_connections 2023-09-29T23:09:07.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:07.672+0000 7fb3c5f44700 1 -- 172.21.15.115:0/3814498746 wait complete. 2023-09-29T23:09:09.237 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:09:09.240 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:09:10.687 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:10.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 Processor -- start 2023-09-29T23:09:10.799 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 -- start start 2023-09-29T23:09:10.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f528409fc60 0x7f52840a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:10.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f528413fe10 0x7f5284140270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:10.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52840a0030 con 0x7f5284142e50 2023-09-29T23:09:10.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52840a1ac0 con 0x7f528413fe10 2023-09-29T23:09:10.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528413fb70 con 0x7f528409fc60 2023-09-29T23:09:10.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a195700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f528413fe10 0x7f5284140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:10.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f5289994700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f528409fc60 0x7f52840a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:10.801 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a195700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f528413fe10 0x7f5284140270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32910/0 (socket says 172.21.15.115:32910) 2023-09-29T23:09:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a195700 1 -- 172.21.15.115:0/1106217246 learned_addr learned my addr 172.21.15.115:0/1106217246 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a195700 1 -- 172.21.15.115:0/1106217246 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f528409fc60 msgr2=0x7f52840a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a195700 1 --2- 172.21.15.115:0/1106217246 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f528409fc60 0x7f52840a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a195700 1 -- 172.21.15.115:0/1106217246 >> v1:172.21.15.156:6789/0 conn(0x7f5284142e50 legacy=0x7f52841434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a195700 1 -- 172.21.15.115:0/1106217246 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528413f8d0 con 0x7f528413fe10 2023-09-29T23:09:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a195700 1 --2- 172.21.15.115:0/1106217246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f528413fe10 0x7f5284140270 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f527c009f20 tx=0x7f527c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd32dafa56e0d29 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f5288992700 1 -- 172.21.15.115:0/1106217246 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c00e070 con 0x7f528413fe10 2023-09-29T23:09:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f5288992700 1 -- 172.21.15.115:0/1106217246 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c00b990 con 0x7f528413fe10 2023-09-29T23:09:10.802 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f5288992700 1 -- 172.21.15.115:0/1106217246 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c0092e0 con 0x7f528413fe10 2023-09-29T23:09:10.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 -- 172.21.15.115:0/1106217246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f528413fe10 msgr2=0x7f5284140270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:10.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 --2- 172.21.15.115:0/1106217246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f528413fe10 0x7f5284140270 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f527c009f20 tx=0x7f527c009840 comp rx=0 tx=0).stop 2023-09-29T23:09:10.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 -- 172.21.15.115:0/1106217246 shutdown_connections 2023-09-29T23:09:10.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 --2- 172.21.15.115:0/1106217246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f528413fe10 0x7f5284140270 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:10.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 --2- 172.21.15.115:0/1106217246 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f528409fc60 0x7f52840a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:10.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 -- 172.21.15.115:0/1106217246 >> 172.21.15.115:0/1106217246 conn(0x7f52840b6c10 msgr2=0x7f5284067bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:10.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 -- 172.21.15.115:0/1106217246 shutdown_connections 2023-09-29T23:09:10.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.795+0000 7f528a996700 1 -- 172.21.15.115:0/1106217246 wait complete. 2023-09-29T23:09:10.805 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a996700 1 Processor -- start 2023-09-29T23:09:10.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a996700 1 -- start start 2023-09-29T23:09:10.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a996700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f528409fc60 0x7f5284145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:10.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a996700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f528413fe10 0x7f5284097a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:10.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a996700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5284142e50 0x7f5284097f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:10.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a996700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52841496d0 con 0x7f5284142e50 2023-09-29T23:09:10.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a996700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52840a5e20 con 0x7f528409fc60 2023-09-29T23:09:10.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a996700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5284097120 con 0x7f528413fe10 2023-09-29T23:09:10.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a195700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5284142e50 0x7f5284097f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:10.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a195700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5284142e50 0x7f5284097f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32912/0 (socket says 172.21.15.115:32912) 2023-09-29T23:09:10.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a195700 1 -- 172.21.15.115:0/999185102 learned_addr learned my addr 172.21.15.115:0/999185102 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:10.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f5289193700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f528413fe10 0x7f5284097a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:10.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f5289994700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f528409fc60 0x7f5284145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:10.806 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a195700 1 -- 172.21.15.115:0/999185102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f528413fe10 msgr2=0x7f5284097a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:10.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a195700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f528413fe10 0x7f5284097a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:10.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a195700 1 -- 172.21.15.115:0/999185102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f528409fc60 msgr2=0x7f5284145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:10.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a195700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f528409fc60 0x7f5284145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:10.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a195700 1 -- 172.21.15.115:0/999185102 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c009ae0 con 0x7f5284142e50 2023-09-29T23:09:10.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f5289994700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f528409fc60 0x7f5284145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:09:10.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a195700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5284142e50 0x7f5284097f60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f528406a160 tx=0x7f527c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:10.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f5279ffb700 1 -- 172.21.15.115:0/999185102 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c012ba0 con 0x7f5284142e50 2023-09-29T23:09:10.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f5279ffb700 1 -- 172.21.15.115:0/999185102 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c012d20 con 0x7f5284142e50 2023-09-29T23:09:10.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a996700 1 -- 172.21.15.115:0/999185102 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5284152930 con 0x7f5284142e50 2023-09-29T23:09:10.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f5279ffb700 1 -- 172.21.15.115:0/999185102 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c01d670 con 0x7f5284142e50 2023-09-29T23:09:10.807 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.799+0000 7f528a996700 1 -- 172.21.15.115:0/999185102 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52841457d0 con 0x7f5284142e50 2023-09-29T23:09:10.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.803+0000 7f528a996700 1 -- 172.21.15.115:0/999185102 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52840a5fd0 con 0x7f5284142e50 2023-09-29T23:09:10.808 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.803+0000 7f5279ffb700 1 -- 172.21.15.115:0/999185102 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f527c01d9e0 con 0x7f5284142e50 2023-09-29T23:09:10.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.803+0000 7f5279ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:10.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.803+0000 7f5279ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:10.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.803+0000 7f5279ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:10.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.803+0000 7f5279ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:10.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.803+0000 7f5279ffb700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f526808e860 0x7f5268090d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:10.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.803+0000 7f5279ffb700 1 -- 172.21.15.115:0/999185102 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f527c0b5fa0 con 0x7f5284142e50 2023-09-29T23:09:10.809 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.803+0000 7f5289994700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f526808e860 0x7f5268090d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:10.810 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.803+0000 7f5289994700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f526808e860 0x7f5268090d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5280006f00 tx=0x7f5280008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:10.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:10.811+0000 7f5279ffb700 1 -- 172.21.15.115:0/999185102 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f527c0e5be0 con 0x7f5284142e50 2023-09-29T23:09:11.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.007+0000 7f528a996700 1 -- 172.21.15.115:0/999185102 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f528404be00 con 0x7f5284142e50 2023-09-29T23:09:11.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.007+0000 7f5279ffb700 1 -- 172.21.15.115:0/999185102 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f52840a5fd0 con 0x7f5284142e50 2023-09-29T23:09:11.012 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:11.012 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:11.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.011+0000 7f528a996700 10 mgrc shutdown 2023-09-29T23:09:11.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.011+0000 7f528a996700 1 -- 172.21.15.115:0/999185102 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f526808e860 msgr2=0x7f5268090d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:11.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.011+0000 7f528a996700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f526808e860 0x7f5268090d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5280006f00 tx=0x7f5280008040 comp rx=0 tx=0).stop 2023-09-29T23:09:11.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.011+0000 7f528a996700 1 -- 172.21.15.115:0/999185102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5284142e50 msgr2=0x7f5284097f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:11.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.011+0000 7f528a996700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5284142e50 0x7f5284097f60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f528406a160 tx=0x7f527c017000 comp rx=0 tx=0).stop 2023-09-29T23:09:11.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.011+0000 7f528a996700 1 -- 172.21.15.115:0/999185102 shutdown_connections 2023-09-29T23:09:11.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.011+0000 7f528a996700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f526808e860 0x7f5268090d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:11.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.011+0000 7f528a996700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5284142e50 0x7f5284097f60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:11.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.011+0000 7f528a996700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f528413fe10 0x7f5284097a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:11.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.011+0000 7f528a996700 1 --2- 172.21.15.115:0/999185102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f528409fc60 0x7f5284145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:11.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.011+0000 7f528a996700 1 -- 172.21.15.115:0/999185102 >> 172.21.15.115:0/999185102 conn(0x7f52840b6c10 msgr2=0x7f528413ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:11.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.011+0000 7f528a996700 1 -- 172.21.15.115:0/999185102 shutdown_connections 2023-09-29T23:09:11.016 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:11.011+0000 7f528a996700 1 -- 172.21.15.115:0/999185102 wait complete. 2023-09-29T23:09:14.027 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:14.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb922f3700 1 Processor -- start 2023-09-29T23:09:14.140 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb922f3700 1 -- start start 2023-09-29T23:09:14.141 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb922f3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feb8c0670a0 0x7feb8c067a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:14.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb922f3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb8c067f60 0x7feb8c14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:14.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb922f3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8c0a3710 con 0x7feb8c0a4140 2023-09-29T23:09:14.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb922f3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8c09bd40 con 0x7feb8c0670a0 2023-09-29T23:09:14.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb922f3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0a4510 con 0x7feb8c067f60 2023-09-29T23:09:14.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb912f1700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7feb8c0a4140 0x7feb8c09d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56062/0 (socket says 172.21.15.115:56062) 2023-09-29T23:09:14.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb912f1700 1 -- 172.21.15.115:0/3738392777 learned_addr learned my addr 172.21.15.115:0/3738392777 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:09:14.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb91af2700 1 --2- 172.21.15.115:0/3738392777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb8c067f60 0x7feb8c14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:14.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb90af0700 1 --2- 172.21.15.115:0/3738392777 >> v2:172.21.15.156:3300/0 conn(0x7feb8c0670a0 0x7feb8c067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:14.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb83fff700 1 -- 172.21.15.115:0/3738392777 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017378954 0 0) 0x7feb8c0a3710 con 0x7feb8c0a4140 2023-09-29T23:09:14.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb83fff700 1 -- 172.21.15.115:0/3738392777 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb78003570 con 0x7feb8c0a4140 2023-09-29T23:09:14.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb91af2700 1 -- 172.21.15.115:0/3738392777 >> v2:172.21.15.156:3300/0 conn(0x7feb8c0670a0 msgr2=0x7feb8c067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:14.142 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb91af2700 1 --2- 172.21.15.115:0/3738392777 >> v2:172.21.15.156:3300/0 conn(0x7feb8c0670a0 0x7feb8c067a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:14.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb91af2700 1 -- 172.21.15.115:0/3738392777 >> v1:172.21.15.115:6789/0 conn(0x7feb8c0a4140 legacy=0x7feb8c09d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:14.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb91af2700 1 -- 172.21.15.115:0/3738392777 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c0686b0 con 0x7feb8c067f60 2023-09-29T23:09:14.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb91af2700 1 --2- 172.21.15.115:0/3738392777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb8c067f60 0x7feb8c14e7c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feb84009e60 tx=0x7feb84009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb7e79188a89ebce server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:14.143 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb83fff700 1 -- 172.21.15.115:0/3738392777 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8400e070 con 0x7feb8c067f60 2023-09-29T23:09:14.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb83fff700 1 -- 172.21.15.115:0/3738392777 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8400bb40 con 0x7feb8c067f60 2023-09-29T23:09:14.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.135+0000 7feb83fff700 1 -- 172.21.15.115:0/3738392777 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84012430 con 0x7feb8c067f60 2023-09-29T23:09:14.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 -- 172.21.15.115:0/3738392777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb8c067f60 msgr2=0x7feb8c14e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:14.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 --2- 172.21.15.115:0/3738392777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb8c067f60 0x7feb8c14e7c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feb84009e60 tx=0x7feb84009780 comp rx=0 tx=0).stop 2023-09-29T23:09:14.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 -- 172.21.15.115:0/3738392777 shutdown_connections 2023-09-29T23:09:14.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 --2- 172.21.15.115:0/3738392777 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb8c067f60 0x7feb8c14e7c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:14.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 --2- 172.21.15.115:0/3738392777 >> v2:172.21.15.156:3300/0 conn(0x7feb8c0670a0 0x7feb8c067a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:14.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 -- 172.21.15.115:0/3738392777 >> 172.21.15.115:0/3738392777 conn(0x7feb8c0b1d20 msgr2=0x7feb8c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:14.145 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 -- 172.21.15.115:0/3738392777 shutdown_connections 2023-09-29T23:09:14.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 -- 172.21.15.115:0/3738392777 wait complete. 2023-09-29T23:09:14.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 Processor -- start 2023-09-29T23:09:14.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 -- start start 2023-09-29T23:09:14.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb8c0670a0 0x7feb8c095270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:14.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb8c067f60 0x7feb8c0963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:14.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb8c0a4140 0x7feb8c156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:14.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c096e20 con 0x7feb8c0a4140 2023-09-29T23:09:14.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c06e6f0 con 0x7feb8c067f60 2023-09-29T23:09:14.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c14b380 con 0x7feb8c0670a0 2023-09-29T23:09:14.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb91af2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb8c0a4140 0x7feb8c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:14.146 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb912f1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb8c0670a0 0x7feb8c095270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:14.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb90af0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb8c067f60 0x7feb8c0963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:14.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb91af2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb8c0a4140 0x7feb8c156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35326/0 (socket says 172.21.15.115:35326) 2023-09-29T23:09:14.147 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb91af2700 1 -- 172.21.15.115:0/955654831 learned_addr learned my addr 172.21.15.115:0/955654831 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:14.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb90af0700 1 -- 172.21.15.115:0/955654831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb8c0670a0 msgr2=0x7feb8c095270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:14.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb90af0700 1 --2- 172.21.15.115:0/955654831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb8c0670a0 0x7feb8c095270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:14.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb90af0700 1 -- 172.21.15.115:0/955654831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb8c0a4140 msgr2=0x7feb8c156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:14.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb90af0700 1 --2- 172.21.15.115:0/955654831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb8c0a4140 0x7feb8c156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:14.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb90af0700 1 -- 172.21.15.115:0/955654831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb84009a20 con 0x7feb8c067f60 2023-09-29T23:09:14.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb90af0700 1 --2- 172.21.15.115:0/955654831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb8c067f60 0x7feb8c0963a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb8800ea80 tx=0x7feb880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:14.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb817fa700 1 -- 172.21.15.115:0/955654831 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800eec0 con 0x7feb8c067f60 2023-09-29T23:09:14.148 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb817fa700 1 -- 172.21.15.115:0/955654831 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8800c880 con 0x7feb8c067f60 2023-09-29T23:09:14.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 -- 172.21.15.115:0/955654831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8c06e890 con 0x7feb8c067f60 2023-09-29T23:09:14.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb817fa700 1 -- 172.21.15.115:0/955654831 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800cc00 con 0x7feb8c067f60 2023-09-29T23:09:14.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.139+0000 7feb922f3700 1 -- 172.21.15.115:0/955654831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8c14acf0 con 0x7feb8c067f60 2023-09-29T23:09:14.149 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.143+0000 7feb922f3700 1 -- 172.21.15.115:0/955654831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c04be00 con 0x7feb8c067f60 2023-09-29T23:09:14.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.147+0000 7feb817fa700 1 -- 172.21.15.115:0/955654831 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7feb88013470 con 0x7feb8c067f60 2023-09-29T23:09:14.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.147+0000 7feb817fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.147+0000 7feb817fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.147+0000 7feb817fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.147+0000 7feb817fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:14.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.147+0000 7feb817fa700 1 --2- 172.21.15.115:0/955654831 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7feb7008e8b0 0x7feb70090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:14.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.147+0000 7feb817fa700 1 -- 172.21.15.115:0/955654831 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7feb880b5310 con 0x7feb8c067f60 2023-09-29T23:09:14.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.147+0000 7feb912f1700 1 --2- 172.21.15.115:0/955654831 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7feb7008e8b0 0x7feb70090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:14.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.147+0000 7feb912f1700 1 --2- 172.21.15.115:0/955654831 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7feb7008e8b0 0x7feb70090d60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feb7c007fd0 tx=0x7feb7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:14.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.155+0000 7feb817fa700 1 -- 172.21.15.115:0/955654831 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7feb880896a0 con 0x7feb8c067f60 2023-09-29T23:09:14.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.351+0000 7feb922f3700 1 -- 172.21.15.115:0/955654831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7feb8c0aed90 con 0x7feb8c067f60 2023-09-29T23:09:14.357 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.351+0000 7feb817fa700 1 -- 172.21.15.115:0/955654831 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7feb88021100 con 0x7feb8c067f60 2023-09-29T23:09:14.357 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:14.357 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.355+0000 7feb922f3700 10 mgrc shutdown 2023-09-29T23:09:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.355+0000 7feb922f3700 1 -- 172.21.15.115:0/955654831 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7feb7008e8b0 msgr2=0x7feb70090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.355+0000 7feb922f3700 1 --2- 172.21.15.115:0/955654831 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7feb7008e8b0 0x7feb70090d60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feb7c007fd0 tx=0x7feb7c009040 comp rx=0 tx=0).stop 2023-09-29T23:09:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.355+0000 7feb922f3700 1 -- 172.21.15.115:0/955654831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb8c067f60 msgr2=0x7feb8c0963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.355+0000 7feb922f3700 1 --2- 172.21.15.115:0/955654831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb8c067f60 0x7feb8c0963a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb8800ea80 tx=0x7feb880091a0 comp rx=0 tx=0).stop 2023-09-29T23:09:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.355+0000 7feb922f3700 1 -- 172.21.15.115:0/955654831 shutdown_connections 2023-09-29T23:09:14.360 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.355+0000 7feb922f3700 1 --2- 172.21.15.115:0/955654831 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7feb7008e8b0 0x7feb70090d60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:14.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.355+0000 7feb922f3700 1 --2- 172.21.15.115:0/955654831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb8c0a4140 0x7feb8c156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:14.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.355+0000 7feb922f3700 1 --2- 172.21.15.115:0/955654831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb8c067f60 0x7feb8c0963a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:14.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.355+0000 7feb922f3700 1 --2- 172.21.15.115:0/955654831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb8c0670a0 0x7feb8c095270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:14.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.355+0000 7feb922f3700 1 -- 172.21.15.115:0/955654831 >> 172.21.15.115:0/955654831 conn(0x7feb8c0b1d20 msgr2=0x7feb8c0b0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:14.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.355+0000 7feb922f3700 1 -- 172.21.15.115:0/955654831 shutdown_connections 2023-09-29T23:09:14.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:14.355+0000 7feb922f3700 1 -- 172.21.15.115:0/955654831 wait complete. 2023-09-29T23:09:17.373 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:17.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.479+0000 7f84fe5c0700 1 Processor -- start 2023-09-29T23:09:17.486 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.479+0000 7f84fe5c0700 1 -- start start 2023-09-29T23:09:17.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.479+0000 7f84fe5c0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84f80670a0 0x7f84f8067a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:17.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.479+0000 7f84fe5c0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f84f8067f60 0x7f84f814e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:17.487 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.479+0000 7f84fe5c0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f80a3710 con 0x7f84f80a4140 2023-09-29T23:09:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.479+0000 7f84fe5c0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f809bd40 con 0x7f84f8067f60 2023-09-29T23:09:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.479+0000 7f84fe5c0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80a4510 con 0x7f84f80670a0 2023-09-29T23:09:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.479+0000 7f84fddbf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f84f8067f60 0x7f84f814e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.479+0000 7f84fddbf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f84f8067f60 0x7f84f814e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35334/0 (socket says 172.21.15.115:35334) 2023-09-29T23:09:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.479+0000 7f84fddbf700 1 -- 172.21.15.115:0/4192330504 learned_addr learned my addr 172.21.15.115:0/4192330504 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.479+0000 7f84fd5be700 1 --1- 172.21.15.115:0/4192330504 >> v1:172.21.15.115:6789/0 conn(0x7f84f80a4140 0x7f84f809d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56064/0 (socket says 172.21.15.115:56064) 2023-09-29T23:09:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.479+0000 7f84fcdbd700 1 --2- 172.21.15.115:0/4192330504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84f80670a0 0x7f84f8067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84fddbf700 1 -- 172.21.15.115:0/4192330504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84f80670a0 msgr2=0x7f84f8067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84fddbf700 1 --2- 172.21.15.115:0/4192330504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84f80670a0 0x7f84f8067a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84fddbf700 1 -- 172.21.15.115:0/4192330504 >> v1:172.21.15.115:6789/0 conn(0x7f84f80a4140 legacy=0x7f84f809d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84fddbf700 1 -- 172.21.15.115:0/4192330504 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f80686b0 con 0x7f84f8067f60 2023-09-29T23:09:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84fddbf700 1 --2- 172.21.15.115:0/4192330504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f8067f60 0x7f84f814e7c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009f20 tx=0x7f84f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d130c1c66e864 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84effff700 1 -- 172.21.15.115:0/4192330504 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f000e070 con 0x7f84f8067f60 2023-09-29T23:09:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84effff700 1 -- 172.21.15.115:0/4192330504 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f000bb10 con 0x7f84f8067f60 2023-09-29T23:09:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84effff700 1 -- 172.21.15.115:0/4192330504 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00092e0 con 0x7f84f8067f60 2023-09-29T23:09:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84fe5c0700 1 -- 172.21.15.115:0/4192330504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f8067f60 msgr2=0x7f84f814e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84fe5c0700 1 --2- 172.21.15.115:0/4192330504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f8067f60 0x7f84f814e7c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009f20 tx=0x7f84f0009840 comp rx=0 tx=0).stop 2023-09-29T23:09:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84fe5c0700 1 -- 172.21.15.115:0/4192330504 shutdown_connections 2023-09-29T23:09:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84fe5c0700 1 --2- 172.21.15.115:0/4192330504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f8067f60 0x7f84f814e7c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84fe5c0700 1 --2- 172.21.15.115:0/4192330504 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84f80670a0 0x7f84f8067a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84fe5c0700 1 -- 172.21.15.115:0/4192330504 >> 172.21.15.115:0/4192330504 conn(0x7f84f80b1d20 msgr2=0x7f84f80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84fe5c0700 1 -- 172.21.15.115:0/4192330504 shutdown_connections 2023-09-29T23:09:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.483+0000 7f84fe5c0700 1 -- 172.21.15.115:0/4192330504 wait complete. 2023-09-29T23:09:17.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fe5c0700 1 Processor -- start 2023-09-29T23:09:17.491 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fe5c0700 1 -- start start 2023-09-29T23:09:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fe5c0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84f80670a0 0x7f84f806e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fe5c0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f8067f60 0x7f84f80992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fe5c0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84f80a4140 0x7f84f8099830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fe5c0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f8098e80 con 0x7f84f8067f60 2023-09-29T23:09:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fe5c0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f8148740 con 0x7f84f80a4140 2023-09-29T23:09:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fe5c0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f8099ea0 con 0x7f84f80670a0 2023-09-29T23:09:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fd5be700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84f80670a0 0x7f84f806e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fd5be700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84f80670a0 0x7f84f806e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:39648/0 (socket says 172.21.15.115:39648) 2023-09-29T23:09:17.493 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fd5be700 1 -- 172.21.15.115:0/2433745111 learned_addr learned my addr 172.21.15.115:0/2433745111 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:17.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fcdbd700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f8067f60 0x7f84f80992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:17.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fddbf700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84f80a4140 0x7f84f8099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:17.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fd5be700 1 -- 172.21.15.115:0/2433745111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84f80a4140 msgr2=0x7f84f8099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:17.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fd5be700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84f80a4140 0x7f84f8099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:17.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fd5be700 1 -- 172.21.15.115:0/2433745111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f8067f60 msgr2=0x7f84f80992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:17.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fd5be700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f8067f60 0x7f84f80992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:17.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fd5be700 1 -- 172.21.15.115:0/2433745111 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f0009ae0 con 0x7f84f80670a0 2023-09-29T23:09:17.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fd5be700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84f80670a0 0x7f84f806e6b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f84e800c560 tx=0x7f84e8007f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:17.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84ed7fa700 1 -- 172.21.15.115:0/2433745111 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e8007360 con 0x7f84f80670a0 2023-09-29T23:09:17.495 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84ed7fa700 1 -- 172.21.15.115:0/2433745111 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e80074c0 con 0x7f84f80670a0 2023-09-29T23:09:17.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fe5c0700 1 -- 172.21.15.115:0/2433745111 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f809a160 con 0x7f84f80670a0 2023-09-29T23:09:17.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84ed7fa700 1 -- 172.21.15.115:0/2433745111 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e8004830 con 0x7f84f80670a0 2023-09-29T23:09:17.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.487+0000 7f84fe5c0700 1 -- 172.21.15.115:0/2433745111 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f806eff0 con 0x7f84f80670a0 2023-09-29T23:09:17.496 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.491+0000 7f84fe5c0700 1 -- 172.21.15.115:0/2433745111 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f804be00 con 0x7f84f80670a0 2023-09-29T23:09:17.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.491+0000 7f84ed7fa700 1 -- 172.21.15.115:0/2433745111 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f84e8004c60 con 0x7f84f80670a0 2023-09-29T23:09:17.498 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.491+0000 7f84ed7fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:17.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.495+0000 7f84ed7fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:17.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.495+0000 7f84ed7fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:17.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.495+0000 7f84ed7fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:17.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.495+0000 7f84ed7fa700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f84dc08e830 0x7f84dc090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:17.499 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.495+0000 7f84ed7fa700 1 -- 172.21.15.115:0/2433745111 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f84e80b4f10 con 0x7f84f80670a0 2023-09-29T23:09:17.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.495+0000 7f84fcdbd700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f84dc08e830 0x7f84dc090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:17.500 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.495+0000 7f84fcdbd700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f84dc08e830 0x7f84dc090ce0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f84f8095ac0 tx=0x7f84f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:17.501 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.495+0000 7f84ed7fa700 1 -- 172.21.15.115:0/2433745111 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f84e8085810 con 0x7f84f80670a0 2023-09-29T23:09:17.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.687+0000 7f84fe5c0700 1 -- 172.21.15.115:0/2433745111 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f84f80aed90 con 0x7f84f80670a0 2023-09-29T23:09:17.694 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.687+0000 7f84ed7fa700 1 -- 172.21.15.115:0/2433745111 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f84e8088e30 con 0x7f84f80670a0 2023-09-29T23:09:17.694 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:17.695 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:17.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.691+0000 7f84fe5c0700 10 mgrc shutdown 2023-09-29T23:09:17.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.691+0000 7f84fe5c0700 1 -- 172.21.15.115:0/2433745111 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f84dc08e830 msgr2=0x7f84dc090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:17.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.691+0000 7f84fe5c0700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f84dc08e830 0x7f84dc090ce0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f84f8095ac0 tx=0x7f84f4008040 comp rx=0 tx=0).stop 2023-09-29T23:09:17.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.691+0000 7f84fe5c0700 1 -- 172.21.15.115:0/2433745111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84f80670a0 msgr2=0x7f84f806e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:17.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.691+0000 7f84fe5c0700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84f80670a0 0x7f84f806e6b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f84e800c560 tx=0x7f84e8007f40 comp rx=0 tx=0).stop 2023-09-29T23:09:17.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.691+0000 7f84fe5c0700 1 -- 172.21.15.115:0/2433745111 shutdown_connections 2023-09-29T23:09:17.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.691+0000 7f84fe5c0700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84f80a4140 0x7f84f8099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:17.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.691+0000 7f84fe5c0700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f84dc08e830 0x7f84dc090ce0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:17.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.691+0000 7f84fe5c0700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f8067f60 0x7f84f80992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:17.697 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.691+0000 7f84fe5c0700 1 --2- 172.21.15.115:0/2433745111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84f80670a0 0x7f84f806e6b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:17.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.691+0000 7f84fe5c0700 1 -- 172.21.15.115:0/2433745111 >> 172.21.15.115:0/2433745111 conn(0x7f84f80b1d20 msgr2=0x7f84f80a0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:17.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.691+0000 7f84fe5c0700 1 -- 172.21.15.115:0/2433745111 shutdown_connections 2023-09-29T23:09:17.698 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:17.691+0000 7f84fe5c0700 1 -- 172.21.15.115:0/2433745111 wait complete. 2023-09-29T23:09:20.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:20.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 Processor -- start 2023-09-29T23:09:20.827 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 -- start start 2023-09-29T23:09:20.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a32d0 0x7f803c09e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:20.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f803c0a0f50 0x7f803c147090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:20.828 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c13c680 con 0x7f803c0a36a0 2023-09-29T23:09:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803c13fd50 con 0x7f803c0a0f50 2023-09-29T23:09:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c13fff0 con 0x7f803c0a32d0 2023-09-29T23:09:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803259c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f803c0a36a0 0x7f803c09c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:56076/0 (socket says 172.21.15.115:56076) 2023-09-29T23:09:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803259c700 1 -- 172.21.15.115:0/3535928943 learned_addr learned my addr 172.21.15.115:0/3535928943 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:09:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803ad9d700 1 --2- 172.21.15.115:0/3535928943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a32d0 0x7f803c09e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803b59e700 1 --2- 172.21.15.115:0/3535928943 >> v2:172.21.15.156:3300/0 conn(0x7f803c0a0f50 0x7f803c147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803a59c700 1 -- 172.21.15.115:0/3535928943 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742833230 0 0) 0x7f803c13c680 con 0x7f803c0a36a0 2023-09-29T23:09:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803a59c700 1 -- 172.21.15.115:0/3535928943 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8028003570 con 0x7f803c0a36a0 2023-09-29T23:09:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803ad9d700 1 -- 172.21.15.115:0/3535928943 >> v2:172.21.15.156:3300/0 conn(0x7f803c0a0f50 msgr2=0x7f803c147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803a59c700 1 -- 172.21.15.115:0/3535928943 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 586702404 0 0) 0x7f8028003570 con 0x7f803c0a36a0 2023-09-29T23:09:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803ad9d700 1 --2- 172.21.15.115:0/3535928943 >> v2:172.21.15.156:3300/0 conn(0x7f803c0a0f50 0x7f803c147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:20.829 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803ad9d700 1 -- 172.21.15.115:0/3535928943 >> v1:172.21.15.115:6789/0 conn(0x7f803c0a36a0 legacy=0x7f803c09c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:20.830 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803ad9d700 1 -- 172.21.15.115:0/3535928943 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c140290 con 0x7f803c0a32d0 2023-09-29T23:09:20.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803ad9d700 1 --2- 172.21.15.115:0/3535928943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a32d0 0x7f803c09e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f802c0098e0 tx=0x7f802c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=267c4bee3ac96792 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:20.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803a59c700 1 -- 172.21.15.115:0/3535928943 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8024001470 con 0x7f803c0a32d0 2023-09-29T23:09:20.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803a59c700 1 -- 172.21.15.115:0/3535928943 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c011420 con 0x7f803c0a32d0 2023-09-29T23:09:20.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f803a59c700 1 -- 172.21.15.115:0/3535928943 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0117a0 con 0x7f803c0a32d0 2023-09-29T23:09:20.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 -- 172.21.15.115:0/3535928943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a32d0 msgr2=0x7f803c09e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:20.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 --2- 172.21.15.115:0/3535928943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a32d0 0x7f803c09e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f802c0098e0 tx=0x7f802c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:09:20.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 -- 172.21.15.115:0/3535928943 shutdown_connections 2023-09-29T23:09:20.831 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 --2- 172.21.15.115:0/3535928943 >> v2:172.21.15.156:3300/0 conn(0x7f803c0a0f50 0x7f803c147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:20.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 --2- 172.21.15.115:0/3535928943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a32d0 0x7f803c09e090 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:20.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 -- 172.21.15.115:0/3535928943 >> 172.21.15.115:0/3535928943 conn(0x7f803c0b1d20 msgr2=0x7f803c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:20.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 -- 172.21.15.115:0/3535928943 shutdown_connections 2023-09-29T23:09:20.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.823+0000 7f80408a8700 1 -- 172.21.15.115:0/3535928943 wait complete. 2023-09-29T23:09:20.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f80408a8700 1 Processor -- start 2023-09-29T23:09:20.832 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f80408a8700 1 -- start start 2023-09-29T23:09:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f80408a8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a0f50 0x7f803c06ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f80408a8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0a32d0 0x7f803c14b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f80408a8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803c0a36a0 0x7f803c14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f80408a8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c14bfb0 con 0x7f803c0a32d0 2023-09-29T23:09:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f80408a8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c095bc0 con 0x7f803c0a36a0 2023-09-29T23:09:20.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f80408a8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c14c1c0 con 0x7f803c0a0f50 2023-09-29T23:09:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f803ad9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a0f50 0x7f803c06ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f803259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0a32d0 0x7f803c14b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f803ad9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a0f50 0x7f803c06ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:39666/0 (socket says 172.21.15.115:39666) 2023-09-29T23:09:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f803ad9d700 1 -- 172.21.15.115:0/1981267854 learned_addr learned my addr 172.21.15.115:0/1981267854 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f803b59e700 1 --2- 172.21.15.115:0/1981267854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803c0a36a0 0x7f803c14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f803259c700 1 -- 172.21.15.115:0/1981267854 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a0f50 msgr2=0x7f803c06ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f803259c700 1 --2- 172.21.15.115:0/1981267854 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a0f50 0x7f803c06ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f803259c700 1 -- 172.21.15.115:0/1981267854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803c0a36a0 msgr2=0x7f803c14ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f803259c700 1 --2- 172.21.15.115:0/1981267854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803c0a36a0 0x7f803c14ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:20.835 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.827+0000 7f803259c700 1 -- 172.21.15.115:0/1981267854 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c009420 con 0x7f803c0a32d0 2023-09-29T23:09:20.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.831+0000 7f803259c700 1 --2- 172.21.15.115:0/1981267854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0a32d0 0x7f803c14b530 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f802400c860 tx=0x7f8024001580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:20.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.831+0000 7f80337fe700 1 -- 172.21.15.115:0/1981267854 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8024005b30 con 0x7f803c0a32d0 2023-09-29T23:09:20.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.831+0000 7f80337fe700 1 -- 172.21.15.115:0/1981267854 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8024005c90 con 0x7f803c0a32d0 2023-09-29T23:09:20.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.831+0000 7f80408a8700 1 -- 172.21.15.115:0/1981267854 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803c09af20 con 0x7f803c0a32d0 2023-09-29T23:09:20.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.831+0000 7f80337fe700 1 -- 172.21.15.115:0/1981267854 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8024007340 con 0x7f803c0a32d0 2023-09-29T23:09:20.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.831+0000 7f80408a8700 1 -- 172.21.15.115:0/1981267854 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803c06c990 con 0x7f803c0a32d0 2023-09-29T23:09:20.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.831+0000 7f80337fe700 1 -- 172.21.15.115:0/1981267854 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f802401b400 con 0x7f803c0a32d0 2023-09-29T23:09:20.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.831+0000 7f80337fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:20.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.831+0000 7f80408a8700 1 -- 172.21.15.115:0/1981267854 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803c09e510 con 0x7f803c0a32d0 2023-09-29T23:09:20.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.835+0000 7f80337fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:20.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.835+0000 7f80337fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:20.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.835+0000 7f80337fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:20.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.835+0000 7f80337fe700 1 --2- 172.21.15.115:0/1981267854 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f801c08e8e0 0x7f801c090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:20.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.835+0000 7f80337fe700 1 -- 172.21.15.115:0/1981267854 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f80240b4420 con 0x7f803c0a32d0 2023-09-29T23:09:20.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.835+0000 7f803ad9d700 1 --2- 172.21.15.115:0/1981267854 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f801c08e8e0 0x7f801c090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:20.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.835+0000 7f803ad9d700 1 --2- 172.21.15.115:0/1981267854 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f801c08e8e0 0x7f801c090d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f802c0093a0 tx=0x7f802c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:20.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:20.839+0000 7f80337fe700 1 -- 172.21.15.115:0/1981267854 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8024088840 con 0x7f803c0a32d0 2023-09-29T23:09:21.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.031+0000 7f80408a8700 1 -- 172.21.15.115:0/1981267854 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f803c04be00 con 0x7f803c0a32d0 2023-09-29T23:09:21.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.031+0000 7f80337fe700 1 -- 172.21.15.115:0/1981267854 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f80240076f0 con 0x7f803c0a32d0 2023-09-29T23:09:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:21.039 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:21.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.035+0000 7f80408a8700 10 mgrc shutdown 2023-09-29T23:09:21.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.035+0000 7f80408a8700 1 -- 172.21.15.115:0/1981267854 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f801c08e8e0 msgr2=0x7f801c090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:21.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.035+0000 7f80408a8700 1 --2- 172.21.15.115:0/1981267854 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f801c08e8e0 0x7f801c090d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f802c0093a0 tx=0x7f802c016000 comp rx=0 tx=0).stop 2023-09-29T23:09:21.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.035+0000 7f80408a8700 1 -- 172.21.15.115:0/1981267854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0a32d0 msgr2=0x7f803c14b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:21.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.035+0000 7f80408a8700 1 --2- 172.21.15.115:0/1981267854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0a32d0 0x7f803c14b530 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f802400c860 tx=0x7f8024001580 comp rx=0 tx=0).stop 2023-09-29T23:09:21.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.035+0000 7f80408a8700 1 -- 172.21.15.115:0/1981267854 shutdown_connections 2023-09-29T23:09:21.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.035+0000 7f80408a8700 1 --2- 172.21.15.115:0/1981267854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f803c0a36a0 0x7f803c14ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:21.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.035+0000 7f80408a8700 1 --2- 172.21.15.115:0/1981267854 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f801c08e8e0 0x7f801c090d90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:21.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.035+0000 7f80408a8700 1 --2- 172.21.15.115:0/1981267854 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f803c0a32d0 0x7f803c14b530 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:21.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.035+0000 7f80408a8700 1 --2- 172.21.15.115:0/1981267854 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f803c0a0f50 0x7f803c06ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:21.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.035+0000 7f80408a8700 1 -- 172.21.15.115:0/1981267854 >> 172.21.15.115:0/1981267854 conn(0x7f803c0b1d20 msgr2=0x7f803c069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:21.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.035+0000 7f80408a8700 1 -- 172.21.15.115:0/1981267854 shutdown_connections 2023-09-29T23:09:21.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:21.035+0000 7f80408a8700 1 -- 172.21.15.115:0/1981267854 wait complete. 2023-09-29T23:09:24.053 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:24.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff441208700 1 Processor -- start 2023-09-29T23:09:24.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff441208700 1 -- start start 2023-09-29T23:09:24.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff441208700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff43c06f630 0x7ff43c14f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:24.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff441208700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43c06f250 con 0x7ff43c06e770 2023-09-29T23:09:24.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff441208700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43c0a49b0 con 0x7ff43c06a7e0 2023-09-29T23:09:24.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff441208700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43c147410 con 0x7ff43c06f630 2023-09-29T23:09:24.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43bfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff43c06e770 0x7ff43c06eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59320/0 (socket says 172.21.15.115:59320) 2023-09-29T23:09:24.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43bfff700 1 -- 172.21.15.115:0/1371643054 learned_addr learned my addr 172.21.15.115:0/1371643054 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:09:24.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff440a07700 1 --2- 172.21.15.115:0/1371643054 >> v2:172.21.15.156:3300/0 conn(0x7ff43c06f630 0x7ff43c14f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:24.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410594887 0 0) 0x7ff43c06f250 con 0x7ff43c06e770 2023-09-29T23:09:24.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff428003570 con 0x7ff43c06e770 2023-09-29T23:09:24.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887948383 0 0) 0x7ff43c0a49b0 con 0x7ff43c06a7e0 2023-09-29T23:09:24.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff43c06f250 con 0x7ff43c06a7e0 2023-09-29T23:09:24.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2045491819 0 0) 0x7ff428003570 con 0x7ff43c06e770 2023-09-29T23:09:24.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 >> v2:172.21.15.156:3300/0 conn(0x7ff43c06f630 msgr2=0x7ff43c14f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:24.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 --2- 172.21.15.115:0/1371643054 >> v2:172.21.15.156:3300/0 conn(0x7ff43c06f630 0x7ff43c14f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:24.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 >> v1:172.21.15.156:6789/0 conn(0x7ff43c06a7e0 legacy=0x7ff43c1435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:24.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c143cc0 con 0x7ff43c06e770 2023-09-29T23:09:24.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3987234196 0 0) 0x7ff424001470 con 0x7ff43c06e770 2023-09-29T23:09:24.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 >> v1:172.21.15.115:6789/0 conn(0x7ff43c06e770 legacy=0x7ff43c06eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:24.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 --2- 172.21.15.115:0/1371643054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff428004c50 0x7ff428005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:24.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 --2- 172.21.15.115:0/1371643054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4280037b0 0x7ff428003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:24.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 --2- 172.21.15.115:0/1371643054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff428004160 0x7ff42800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:24.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c147410 con 0x7ff428004c50 2023-09-29T23:09:24.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42800c0b0 con 0x7ff428004160 2023-09-29T23:09:24.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42800c270 con 0x7ff4280037b0 2023-09-29T23:09:24.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43bfff700 1 --2- 172.21.15.115:0/1371643054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff428004c50 0x7ff428005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:24.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff440a07700 1 --2- 172.21.15.115:0/1371643054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff428004160 0x7ff42800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:24.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43b7fe700 1 --2- 172.21.15.115:0/1371643054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4280037b0 0x7ff428003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:24.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43bfff700 1 -- 172.21.15.115:0/1371643054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4280037b0 msgr2=0x7ff428003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:24.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43bfff700 1 --2- 172.21.15.115:0/1371643054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4280037b0 0x7ff428003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:24.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43bfff700 1 -- 172.21.15.115:0/1371643054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff428004160 msgr2=0x7ff42800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:24.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43bfff700 1 --2- 172.21.15.115:0/1371643054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff428004160 0x7ff42800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:24.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff440a07700 1 -- 172.21.15.115:0/1371643054 reap_dead start 2023-09-29T23:09:24.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.163+0000 7ff43bfff700 1 -- 172.21.15.115:0/1371643054 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff428003570 con 0x7ff428004c50 2023-09-29T23:09:24.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.167+0000 7ff43b7fe700 1 --2- 172.21.15.115:0/1371643054 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4280037b0 0x7ff428003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:09:24.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.167+0000 7ff43bfff700 1 --2- 172.21.15.115:0/1371643054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff428004c50 0x7ff428005040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff42400c2d0 tx=0x7ff424001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63e9359b38174bd server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:24.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.167+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42400cba0 con 0x7ff428004c50 2023-09-29T23:09:24.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.167+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42400cd00 con 0x7ff428004c50 2023-09-29T23:09:24.174 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.167+0000 7ff43affd700 1 -- 172.21.15.115:0/1371643054 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424005b70 con 0x7ff428004c50 2023-09-29T23:09:24.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.167+0000 7ff441208700 1 -- 172.21.15.115:0/1371643054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff428004c50 msgr2=0x7ff428005040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:24.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.167+0000 7ff441208700 1 --2- 172.21.15.115:0/1371643054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff428004c50 0x7ff428005040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff42400c2d0 tx=0x7ff424001e10 comp rx=0 tx=0).stop 2023-09-29T23:09:24.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.167+0000 7ff441208700 1 -- 172.21.15.115:0/1371643054 shutdown_connections 2023-09-29T23:09:24.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.167+0000 7ff441208700 1 --2- 172.21.15.115:0/1371643054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff428004c50 0x7ff428005040 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:24.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.167+0000 7ff441208700 1 -- 172.21.15.115:0/1371643054 >> 172.21.15.115:0/1371643054 conn(0x7ff43c0a3470 msgr2=0x7ff43c0a3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:24.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.167+0000 7ff441208700 1 -- 172.21.15.115:0/1371643054 shutdown_connections 2023-09-29T23:09:24.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.167+0000 7ff441208700 1 -- 172.21.15.115:0/1371643054 wait complete. 2023-09-29T23:09:24.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.167+0000 7ff441208700 1 Processor -- start 2023-09-29T23:09:24.175 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff441208700 1 -- start start 2023-09-29T23:09:24.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff441208700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff428004c50 0x7ff43c157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:24.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff441208700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff43c157740 0x7ff43c0ad480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:24.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff441208700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c0ad9c0 0x7ff43c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:24.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff441208700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c0acf80 con 0x7ff43c0ad9c0 2023-09-29T23:09:24.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff441208700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c157bd0 con 0x7ff428004c50 2023-09-29T23:09:24.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff441208700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c157e90 con 0x7ff43c157740 2023-09-29T23:09:24.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff43b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff43c157740 0x7ff43c0ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:24.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff440a07700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c0ad9c0 0x7ff43c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:24.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff43b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff43c157740 0x7ff43c0ad480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:44956/0 (socket says 172.21.15.115:44956) 2023-09-29T23:09:24.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff43b7fe700 1 -- 172.21.15.115:0/3006629679 learned_addr learned my addr 172.21.15.115:0/3006629679 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:24.177 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff43bfff700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff428004c50 0x7ff43c157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:24.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff440a07700 1 -- 172.21.15.115:0/3006629679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff43c157740 msgr2=0x7ff43c0ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:24.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff440a07700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff43c157740 0x7ff43c0ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:24.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff440a07700 1 -- 172.21.15.115:0/3006629679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff428004c50 msgr2=0x7ff43c157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:24.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff440a07700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff428004c50 0x7ff43c157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:24.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff440a07700 1 -- 172.21.15.115:0/3006629679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c0ade40 con 0x7ff43c0ad9c0 2023-09-29T23:09:24.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff43b7fe700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff43c157740 0x7ff43c0ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:09:24.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff440a07700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c0ad9c0 0x7ff43c0abdd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff43c148450 tx=0x7ff42c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:24.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff433fff700 1 -- 172.21.15.115:0/3006629679 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c013750 con 0x7ff43c0ad9c0 2023-09-29T23:09:24.179 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff433fff700 1 -- 172.21.15.115:0/3006629679 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c0138b0 con 0x7ff43c0ad9c0 2023-09-29T23:09:24.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff441208700 1 -- 172.21.15.115:0/3006629679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43c13f270 con 0x7ff43c0ad9c0 2023-09-29T23:09:24.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff433fff700 1 -- 172.21.15.115:0/3006629679 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c013c50 con 0x7ff43c0ad9c0 2023-09-29T23:09:24.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.171+0000 7ff441208700 1 -- 172.21.15.115:0/3006629679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c0ac4b0 con 0x7ff43c0ad9c0 2023-09-29T23:09:24.180 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.175+0000 7ff441208700 1 -- 172.21.15.115:0/3006629679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c143b20 con 0x7ff43c0ad9c0 2023-09-29T23:09:24.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.175+0000 7ff433fff700 1 -- 172.21.15.115:0/3006629679 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7ff42c014650 con 0x7ff43c0ad9c0 2023-09-29T23:09:24.181 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.175+0000 7ff433fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:24.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.175+0000 7ff433fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:24.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.175+0000 7ff433fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:24.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.175+0000 7ff433fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:24.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.175+0000 7ff433fff700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff41c08e8b0 0x7ff41c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:24.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.175+0000 7ff433fff700 1 -- 172.21.15.115:0/3006629679 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7ff42c0b4df0 con 0x7ff43c0ad9c0 2023-09-29T23:09:24.182 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.175+0000 7ff43bfff700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff41c08e8b0 0x7ff41c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:24.183 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.179+0000 7ff43bfff700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff41c08e8b0 0x7ff41c090d60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff424007c90 tx=0x7ff424015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:24.190 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.183+0000 7ff433fff700 1 -- 172.21.15.115:0/3006629679 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff43c143b20 con 0x7ff43c0ad9c0 2023-09-29T23:09:24.382 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 1 -- 172.21.15.115:0/3006629679 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff43c143b20 con 0x7ff43c0ad9c0 2023-09-29T23:09:24.383 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff433fff700 1 -- 172.21.15.115:0/3006629679 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff42c022100 con 0x7ff43c0ad9c0 2023-09-29T23:09:24.383 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:24.383 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:24.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 10 mgrc shutdown 2023-09-29T23:09:24.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 1 -- 172.21.15.115:0/3006629679 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff41c08e8b0 msgr2=0x7ff41c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:24.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff41c08e8b0 0x7ff41c090d60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff424007c90 tx=0x7ff424015000 comp rx=0 tx=0).stop 2023-09-29T23:09:24.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 1 -- 172.21.15.115:0/3006629679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c0ad9c0 msgr2=0x7ff43c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:24.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c0ad9c0 0x7ff43c0abdd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff43c148450 tx=0x7ff42c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:09:24.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 1 -- 172.21.15.115:0/3006629679 shutdown_connections 2023-09-29T23:09:24.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff41c08e8b0 0x7ff41c090d60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:24.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c0ad9c0 0x7ff43c0abdd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:24.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff43c157740 0x7ff43c0ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:24.386 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 1 --2- 172.21.15.115:0/3006629679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff428004c50 0x7ff43c157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:24.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 1 -- 172.21.15.115:0/3006629679 >> 172.21.15.115:0/3006629679 conn(0x7ff43c0a3470 msgr2=0x7ff43c0a5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:24.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 1 -- 172.21.15.115:0/3006629679 shutdown_connections 2023-09-29T23:09:24.387 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:24.379+0000 7ff441208700 1 -- 172.21.15.115:0/3006629679 wait complete. 2023-09-29T23:09:27.398 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:27.506 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.499+0000 7fd9a6774700 1 Processor -- start 2023-09-29T23:09:27.507 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a6774700 1 -- start start 2023-09-29T23:09:27.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a6774700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd9a0068130 0x7fd9a014f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:27.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a6774700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a00a3710 con 0x7fd9a00670a0 2023-09-29T23:09:27.508 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a6774700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a009bd40 con 0x7fd9a00a4140 2023-09-29T23:09:27.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a6774700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a00a4510 con 0x7fd9a0068130 2023-09-29T23:09:27.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a5f73700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd9a0068130 0x7fd9a014f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:27.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a4f71700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd9a00670a0 0x7fd9a0067a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59322/0 (socket says 172.21.15.115:59322) 2023-09-29T23:09:27.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a5f73700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd9a0068130 0x7fd9a014f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38656/0 (socket says 172.21.15.115:38656) 2023-09-29T23:09:27.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a4f71700 1 -- 172.21.15.115:0/1180411875 learned_addr learned my addr 172.21.15.115:0/1180411875 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:09:27.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a5f73700 1 -- 172.21.15.115:0/1180411875 >> v1:172.21.15.156:6789/0 conn(0x7fd9a00a4140 legacy=0x7fd9a009d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:27.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a5f73700 1 -- 172.21.15.115:0/1180411875 >> v1:172.21.15.115:6789/0 conn(0x7fd9a00670a0 legacy=0x7fd9a0067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:27.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a5f73700 1 -- 172.21.15.115:0/1180411875 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a00686b0 con 0x7fd9a0068130 2023-09-29T23:09:27.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a5f73700 1 --2- 172.21.15.115:0/1180411875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a0068130 0x7fd9a014f7d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd998009e60 tx=0x7fd998009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8414b780cbb6a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:27.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd997fff700 1 -- 172.21.15.115:0/1180411875 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99800e070 con 0x7fd9a0068130 2023-09-29T23:09:27.509 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd997fff700 1 -- 172.21.15.115:0/1180411875 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99800bcc0 con 0x7fd9a0068130 2023-09-29T23:09:27.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd997fff700 1 -- 172.21.15.115:0/1180411875 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd998012680 con 0x7fd9a0068130 2023-09-29T23:09:27.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a6774700 1 -- 172.21.15.115:0/1180411875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a0068130 msgr2=0x7fd9a014f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:27.510 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a6774700 1 --2- 172.21.15.115:0/1180411875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a0068130 0x7fd9a014f7d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd998009e60 tx=0x7fd998009780 comp rx=0 tx=0).stop 2023-09-29T23:09:27.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a6774700 1 -- 172.21.15.115:0/1180411875 shutdown_connections 2023-09-29T23:09:27.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a6774700 1 --2- 172.21.15.115:0/1180411875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a0068130 0x7fd9a014f7d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:27.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a6774700 1 -- 172.21.15.115:0/1180411875 >> 172.21.15.115:0/1180411875 conn(0x7fd9a00b1d20 msgr2=0x7fd9a00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:27.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a6774700 1 -- 172.21.15.115:0/1180411875 shutdown_connections 2023-09-29T23:09:27.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.503+0000 7fd9a6774700 1 -- 172.21.15.115:0/1180411875 wait complete. 2023-09-29T23:09:27.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a6774700 1 Processor -- start 2023-09-29T23:09:27.511 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a6774700 1 -- start start 2023-09-29T23:09:27.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a6774700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a00670a0 0x7fd9a0097bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:27.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a6774700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a0068130 0x7fd9a0099090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:27.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a6774700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9a00a4140 0x7fd9a00995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:27.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a6774700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a0097470 con 0x7fd9a0068130 2023-09-29T23:09:27.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a6774700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a009fd90 con 0x7fd9a00a4140 2023-09-29T23:09:27.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a6774700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a00a0030 con 0x7fd9a00670a0 2023-09-29T23:09:27.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a4f71700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a0068130 0x7fd9a0099090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:27.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a5772700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a00670a0 0x7fd9a0097bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:27.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a4f71700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a0068130 0x7fd9a0099090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38670/0 (socket says 172.21.15.115:38670) 2023-09-29T23:09:27.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a4f71700 1 -- 172.21.15.115:0/4005920986 learned_addr learned my addr 172.21.15.115:0/4005920986 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:27.513 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a5f73700 1 --2- 172.21.15.115:0/4005920986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9a00a4140 0x7fd9a00995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:27.514 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a5772700 1 -- 172.21.15.115:0/4005920986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9a00a4140 msgr2=0x7fd9a00995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:27.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a5772700 1 --2- 172.21.15.115:0/4005920986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9a00a4140 0x7fd9a00995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:27.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a5772700 1 -- 172.21.15.115:0/4005920986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a0068130 msgr2=0x7fd9a0099090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:27.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a5772700 1 --2- 172.21.15.115:0/4005920986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a0068130 0x7fd9a0099090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:27.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a5772700 1 -- 172.21.15.115:0/4005920986 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998009a20 con 0x7fd9a00670a0 2023-09-29T23:09:27.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a5772700 1 --2- 172.21.15.115:0/4005920986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a00670a0 0x7fd9a0097bc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd99000c490 tx=0x7fd990007ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:27.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9957fa700 1 -- 172.21.15.115:0/4005920986 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990011590 con 0x7fd9a00670a0 2023-09-29T23:09:27.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9957fa700 1 -- 172.21.15.115:0/4005920986 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9900116f0 con 0x7fd9a00670a0 2023-09-29T23:09:27.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a6774700 1 -- 172.21.15.115:0/4005920986 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a0097190 con 0x7fd9a00670a0 2023-09-29T23:09:27.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9957fa700 1 -- 172.21.15.115:0/4005920986 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990011ab0 con 0x7fd9a00670a0 2023-09-29T23:09:27.515 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.507+0000 7fd9a6774700 1 -- 172.21.15.115:0/4005920986 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a00a1810 con 0x7fd9a00670a0 2023-09-29T23:09:27.516 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.511+0000 7fd9a6774700 1 -- 172.21.15.115:0/4005920986 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a004be00 con 0x7fd9a00670a0 2023-09-29T23:09:27.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.511+0000 7fd9957fa700 1 -- 172.21.15.115:0/4005920986 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fd99001b3b0 con 0x7fd9a00670a0 2023-09-29T23:09:27.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.511+0000 7fd9957fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:27.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.511+0000 7fd9957fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:27.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.511+0000 7fd9957fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:27.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.511+0000 7fd9957fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:27.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.511+0000 7fd9957fa700 1 --2- 172.21.15.115:0/4005920986 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd98408e8b0 0x7fd984090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:27.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.511+0000 7fd9957fa700 1 -- 172.21.15.115:0/4005920986 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fd9900b3c00 con 0x7fd9a00670a0 2023-09-29T23:09:27.518 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.511+0000 7fd9a4f71700 1 --2- 172.21.15.115:0/4005920986 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd98408e8b0 0x7fd984090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:27.519 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.515+0000 7fd9a4f71700 1 --2- 172.21.15.115:0/4005920986 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd98408e8b0 0x7fd984090d60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd99c000c00 tx=0x7fd99c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:27.526 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.523+0000 7fd9957fa700 1 -- 172.21.15.115:0/4005920986 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd9900ba080 con 0x7fd9a00670a0 2023-09-29T23:09:27.720 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.715+0000 7fd9a6774700 1 -- 172.21.15.115:0/4005920986 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd9a0095030 con 0x7fd9a00670a0 2023-09-29T23:09:27.721 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.715+0000 7fd9957fa700 1 -- 172.21.15.115:0/4005920986 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fd990017070 con 0x7fd9a00670a0 2023-09-29T23:09:27.721 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:27.721 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:27.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.719+0000 7fd9a6774700 10 mgrc shutdown 2023-09-29T23:09:27.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.719+0000 7fd9a6774700 1 -- 172.21.15.115:0/4005920986 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd98408e8b0 msgr2=0x7fd984090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:27.723 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.719+0000 7fd9a6774700 1 --2- 172.21.15.115:0/4005920986 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd98408e8b0 0x7fd984090d60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd99c000c00 tx=0x7fd99c009040 comp rx=0 tx=0).stop 2023-09-29T23:09:27.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.719+0000 7fd9a6774700 1 -- 172.21.15.115:0/4005920986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a00670a0 msgr2=0x7fd9a0097bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:27.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.719+0000 7fd9a6774700 1 --2- 172.21.15.115:0/4005920986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a00670a0 0x7fd9a0097bc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd99000c490 tx=0x7fd990007ea0 comp rx=0 tx=0).stop 2023-09-29T23:09:27.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.719+0000 7fd9a6774700 1 -- 172.21.15.115:0/4005920986 shutdown_connections 2023-09-29T23:09:27.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.719+0000 7fd9a6774700 1 --2- 172.21.15.115:0/4005920986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd9a00a4140 0x7fd9a00995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:27.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.719+0000 7fd9a6774700 1 --2- 172.21.15.115:0/4005920986 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fd98408e8b0 0x7fd984090d60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:27.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.719+0000 7fd9a6774700 1 --2- 172.21.15.115:0/4005920986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a0068130 0x7fd9a0099090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:27.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.719+0000 7fd9a6774700 1 --2- 172.21.15.115:0/4005920986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9a00670a0 0x7fd9a0097bc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:27.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.719+0000 7fd9a6774700 1 -- 172.21.15.115:0/4005920986 >> 172.21.15.115:0/4005920986 conn(0x7fd9a00b1d20 msgr2=0x7fd9a00a29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:27.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.719+0000 7fd9a6774700 1 -- 172.21.15.115:0/4005920986 shutdown_connections 2023-09-29T23:09:27.724 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:27.719+0000 7fd9a6774700 1 -- 172.21.15.115:0/4005920986 wait complete. 2023-09-29T23:09:30.735 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:30.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.839+0000 7f14dd280700 1 Processor -- start 2023-09-29T23:09:30.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.839+0000 7f14dd280700 1 -- start start 2023-09-29T23:09:30.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.839+0000 7f14dd280700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 0x7f14d8067a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:30.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.839+0000 7f14dd280700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d80a3710 con 0x7f14d80a4140 2023-09-29T23:09:30.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.839+0000 7f14dd280700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d809bd40 con 0x7f14d8067f60 2023-09-29T23:09:30.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.839+0000 7f14dd280700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80a4510 con 0x7f14d80670a0 2023-09-29T23:09:30.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14d77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 0x7f14d8067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:30.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14d77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 0x7f14d8067a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:44966/0 (socket says 172.21.15.115:44966) 2023-09-29T23:09:30.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14d77fe700 1 -- 172.21.15.115:0/2644657901 learned_addr learned my addr 172.21.15.115:0/2644657901 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:30.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14d7fff700 1 --1- 172.21.15.115:0/2644657901 >> v1:172.21.15.115:6789/0 conn(0x7f14d80a4140 0x7f14d809d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:59332/0 (socket says 172.21.15.115:59332) 2023-09-29T23:09:30.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14d77fe700 1 -- 172.21.15.115:0/2644657901 >> v1:172.21.15.156:6789/0 conn(0x7f14d8067f60 legacy=0x7f14d814e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:30.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14d77fe700 1 -- 172.21.15.115:0/2644657901 >> v1:172.21.15.115:6789/0 conn(0x7f14d80a4140 legacy=0x7f14d809d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:30.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14d77fe700 1 -- 172.21.15.115:0/2644657901 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80686b0 con 0x7f14d80670a0 2023-09-29T23:09:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14d77fe700 1 --2- 172.21.15.115:0/2644657901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 0x7f14d8067a20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f14c80099e0 tx=0x7f14c8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b63d7660217e06b server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14d6ffd700 1 -- 172.21.15.115:0/2644657901 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c800b8f0 con 0x7f14d80670a0 2023-09-29T23:09:30.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14d6ffd700 1 -- 172.21.15.115:0/2644657901 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c800ba50 con 0x7f14d80670a0 2023-09-29T23:09:30.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14d6ffd700 1 -- 172.21.15.115:0/2644657901 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c800bdf0 con 0x7f14d80670a0 2023-09-29T23:09:30.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14dd280700 1 -- 172.21.15.115:0/2644657901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 msgr2=0x7f14d8067a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:30.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14dd280700 1 --2- 172.21.15.115:0/2644657901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 0x7f14d8067a20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f14c80099e0 tx=0x7f14c8009250 comp rx=0 tx=0).stop 2023-09-29T23:09:30.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14dd280700 1 -- 172.21.15.115:0/2644657901 shutdown_connections 2023-09-29T23:09:30.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14dd280700 1 --2- 172.21.15.115:0/2644657901 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 0x7f14d8067a20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:30.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14dd280700 1 -- 172.21.15.115:0/2644657901 >> 172.21.15.115:0/2644657901 conn(0x7f14d80b1d20 msgr2=0x7f14d80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:30.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14dd280700 1 -- 172.21.15.115:0/2644657901 shutdown_connections 2023-09-29T23:09:30.850 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.843+0000 7f14dd280700 1 -- 172.21.15.115:0/2644657901 wait complete. 2023-09-29T23:09:30.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14dd280700 1 Processor -- start 2023-09-29T23:09:30.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14dd280700 1 -- start start 2023-09-29T23:09:30.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14dd280700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 0x7f14d80968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:30.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14dd280700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14d8067f60 0x7f14d8098c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:30.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14dd280700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d80a4140 0x7f14d8147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:30.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14dd280700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8094c70 con 0x7f14d8067f60 2023-09-29T23:09:30.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14dd280700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80995e0 con 0x7f14d80a4140 2023-09-29T23:09:30.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14dd280700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8099880 con 0x7f14d80670a0 2023-09-29T23:09:30.854 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14d77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14d8067f60 0x7f14d8098c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:30.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14d7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 0x7f14d80968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:30.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14d77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14d8067f60 0x7f14d8098c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38686/0 (socket says 172.21.15.115:38686) 2023-09-29T23:09:30.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14d77fe700 1 -- 172.21.15.115:0/673196227 learned_addr learned my addr 172.21.15.115:0/673196227 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:30.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14d7fff700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 0x7f14d80968c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:44976/0 (socket says 172.21.15.115:44976) 2023-09-29T23:09:30.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14dca7f700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d80a4140 0x7f14d8147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:30.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14d77fe700 1 -- 172.21.15.115:0/673196227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 msgr2=0x7f14d80968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:30.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14d77fe700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 0x7f14d80968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:30.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14d77fe700 1 -- 172.21.15.115:0/673196227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d80a4140 msgr2=0x7f14d8147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:30.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14d77fe700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d80a4140 0x7f14d8147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:30.855 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14d77fe700 1 -- 172.21.15.115:0/673196227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80094f0 con 0x7f14d8067f60 2023-09-29T23:09:30.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14d7fff700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 0x7f14d80968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:09:30.856 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.847+0000 7f14d77fe700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14d8067f60 0x7f14d8098c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009930 tx=0x7f14c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:30.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.851+0000 7f14bffff700 1 -- 172.21.15.115:0/673196227 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8011ea0 con 0x7f14d8067f60 2023-09-29T23:09:30.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.851+0000 7f14bffff700 1 -- 172.21.15.115:0/673196227 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c801a420 con 0x7f14d8067f60 2023-09-29T23:09:30.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.851+0000 7f14dd280700 1 -- 172.21.15.115:0/673196227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d8099b40 con 0x7f14d8067f60 2023-09-29T23:09:30.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.851+0000 7f14bffff700 1 -- 172.21.15.115:0/673196227 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c801a7e0 con 0x7f14d8067f60 2023-09-29T23:09:30.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.851+0000 7f14dd280700 1 -- 172.21.15.115:0/673196227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d80a17f0 con 0x7f14d8067f60 2023-09-29T23:09:30.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.851+0000 7f14dd280700 1 -- 172.21.15.115:0/673196227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d804be00 con 0x7f14d8067f60 2023-09-29T23:09:30.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.851+0000 7f14bffff700 1 -- 172.21.15.115:0/673196227 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f14c802f420 con 0x7f14d8067f60 2023-09-29T23:09:30.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.851+0000 7f14bffff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:30.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.855+0000 7f14bffff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:30.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.855+0000 7f14bffff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:30.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.855+0000 7f14bffff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:30.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.855+0000 7f14bffff700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f14c408e830 0x7f14c4090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:30.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.855+0000 7f14bffff700 1 -- 172.21.15.115:0/673196227 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f14c80b5f70 con 0x7f14d8067f60 2023-09-29T23:09:30.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.855+0000 7f14d7fff700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f14c408e830 0x7f14c4090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:30.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.855+0000 7f14d7fff700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f14c408e830 0x7f14c4090ce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f14cc007fd0 tx=0x7f14cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:30.864 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:30.859+0000 7f14bffff700 1 -- 172.21.15.115:0/673196227 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f14c8086900 con 0x7f14d8067f60 2023-09-29T23:09:31.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 1 -- 172.21.15.115:0/673196227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f14d80aed90 con 0x7f14d8067f60 2023-09-29T23:09:31.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14bffff700 1 -- 172.21.15.115:0/673196227 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f14c8089f20 con 0x7f14d8067f60 2023-09-29T23:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:31.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 10 mgrc shutdown 2023-09-29T23:09:31.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 1 -- 172.21.15.115:0/673196227 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f14c408e830 msgr2=0x7f14c4090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:31.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f14c408e830 0x7f14c4090ce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f14cc007fd0 tx=0x7f14cc009040 comp rx=0 tx=0).stop 2023-09-29T23:09:31.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 1 -- 172.21.15.115:0/673196227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14d8067f60 msgr2=0x7f14d8098c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:31.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14d8067f60 0x7f14d8098c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009930 tx=0x7f14c8017000 comp rx=0 tx=0).stop 2023-09-29T23:09:31.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 1 -- 172.21.15.115:0/673196227 shutdown_connections 2023-09-29T23:09:31.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d80a4140 0x7f14d8147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:31.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f14c408e830 0x7f14c4090ce0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:31.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14d8067f60 0x7f14d8098c50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:31.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 1 --2- 172.21.15.115:0/673196227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14d80670a0 0x7f14d80968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:31.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 1 -- 172.21.15.115:0/673196227 >> 172.21.15.115:0/673196227 conn(0x7f14d80b1d20 msgr2=0x7f14d8069260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:31.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 1 -- 172.21.15.115:0/673196227 shutdown_connections 2023-09-29T23:09:31.063 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:31.055+0000 7f14dd280700 1 -- 172.21.15.115:0/673196227 wait complete. 2023-09-29T23:09:34.081 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:34.191 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba46ecb700 1 Processor -- start 2023-09-29T23:09:34.192 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba46ecb700 1 -- start start 2023-09-29T23:09:34.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba46ecb700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fba4009fc60 0x7fba400a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:34.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba46ecb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba40142e50 0x7fba401434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:34.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba46ecb700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba400a0030 con 0x7fba40143a30 2023-09-29T23:09:34.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba46ecb700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba400a1ac0 con 0x7fba4009fc60 2023-09-29T23:09:34.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba46ecb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4013fb70 con 0x7fba40142e50 2023-09-29T23:09:34.193 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba466ca700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fba40143a30 0x7fba4013fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60040/0 (socket says 172.21.15.115:60040) 2023-09-29T23:09:34.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba466ca700 1 -- 172.21.15.115:0/2381085087 learned_addr learned my addr 172.21.15.115:0/2381085087 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:09:34.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba456c8700 1 --2- 172.21.15.115:0/2381085087 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba40142e50 0x7fba401434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:34.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba45ec9700 1 --2- 172.21.15.115:0/2381085087 >> v2:172.21.15.156:3300/0 conn(0x7fba4009fc60 0x7fba400a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:34.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba44ec7700 1 -- 172.21.15.115:0/2381085087 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106244519 0 0) 0x7fba400a0030 con 0x7fba40143a30 2023-09-29T23:09:34.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba44ec7700 1 -- 172.21.15.115:0/2381085087 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba2c003570 con 0x7fba40143a30 2023-09-29T23:09:34.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba456c8700 1 -- 172.21.15.115:0/2381085087 >> v2:172.21.15.156:3300/0 conn(0x7fba4009fc60 msgr2=0x7fba400a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:34.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba456c8700 1 --2- 172.21.15.115:0/2381085087 >> v2:172.21.15.156:3300/0 conn(0x7fba4009fc60 0x7fba400a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:34.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba456c8700 1 -- 172.21.15.115:0/2381085087 >> v1:172.21.15.115:6789/0 conn(0x7fba40143a30 legacy=0x7fba4013fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:34.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba44ec7700 1 -- 172.21.15.115:0/2381085087 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1922452345 0 0) 0x7fba2c003570 con 0x7fba40143a30 2023-09-29T23:09:34.194 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba456c8700 1 -- 172.21.15.115:0/2381085087 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4013f8d0 con 0x7fba40142e50 2023-09-29T23:09:34.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba456c8700 1 --2- 172.21.15.115:0/2381085087 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba40142e50 0x7fba401434f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba300098e0 tx=0x7fba300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d79d10bb32fa365b server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:34.195 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba44ec7700 1 -- 172.21.15.115:0/2381085087 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba38001470 con 0x7fba40142e50 2023-09-29T23:09:34.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba44ec7700 1 -- 172.21.15.115:0/2381085087 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba30011420 con 0x7fba40142e50 2023-09-29T23:09:34.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.187+0000 7fba44ec7700 1 -- 172.21.15.115:0/2381085087 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300117c0 con 0x7fba40142e50 2023-09-29T23:09:34.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 -- 172.21.15.115:0/2381085087 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba40142e50 msgr2=0x7fba401434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:34.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 --2- 172.21.15.115:0/2381085087 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba40142e50 0x7fba401434f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba300098e0 tx=0x7fba300091a0 comp rx=0 tx=0).stop 2023-09-29T23:09:34.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 -- 172.21.15.115:0/2381085087 shutdown_connections 2023-09-29T23:09:34.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 --2- 172.21.15.115:0/2381085087 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba40142e50 0x7fba401434f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:34.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 --2- 172.21.15.115:0/2381085087 >> v2:172.21.15.156:3300/0 conn(0x7fba4009fc60 0x7fba400a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:34.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 -- 172.21.15.115:0/2381085087 >> 172.21.15.115:0/2381085087 conn(0x7fba400b6c10 msgr2=0x7fba40067bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:34.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 -- 172.21.15.115:0/2381085087 shutdown_connections 2023-09-29T23:09:34.196 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 -- 172.21.15.115:0/2381085087 wait complete. 2023-09-29T23:09:34.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 Processor -- start 2023-09-29T23:09:34.197 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 -- start start 2023-09-29T23:09:34.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba4009fc60 0x7fba400ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:34.198 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba40142e50 0x7fba400aaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:34.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba40143a30 0x7fba4014f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:34.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba400ade30 con 0x7fba40142e50 2023-09-29T23:09:34.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4014ffd0 con 0x7fba40143a30 2023-09-29T23:09:34.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba46ecb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba40150290 con 0x7fba4009fc60 2023-09-29T23:09:34.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba45ec9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba4009fc60 0x7fba400ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:34.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba456c8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba40142e50 0x7fba400aaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:34.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba45ec9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba4009fc60 0x7fba400ad260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:57234/0 (socket says 172.21.15.115:57234) 2023-09-29T23:09:34.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba45ec9700 1 -- 172.21.15.115:0/3823316552 learned_addr learned my addr 172.21.15.115:0/3823316552 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:34.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba466ca700 1 --2- 172.21.15.115:0/3823316552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba40143a30 0x7fba4014f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:34.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba45ec9700 1 -- 172.21.15.115:0/3823316552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba40143a30 msgr2=0x7fba4014f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:34.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.191+0000 7fba45ec9700 1 --2- 172.21.15.115:0/3823316552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba40143a30 0x7fba4014f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:34.199 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.195+0000 7fba45ec9700 1 -- 172.21.15.115:0/3823316552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba40142e50 msgr2=0x7fba400aaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:34.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.195+0000 7fba45ec9700 1 --2- 172.21.15.115:0/3823316552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba40142e50 0x7fba400aaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:34.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.195+0000 7fba45ec9700 1 -- 172.21.15.115:0/3823316552 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30009420 con 0x7fba4009fc60 2023-09-29T23:09:34.200 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.195+0000 7fba45ec9700 1 --2- 172.21.15.115:0/3823316552 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba4009fc60 0x7fba400ad260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba28009ef0 tx=0x7fba2800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:34.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.195+0000 7fba3dffb700 1 -- 172.21.15.115:0/3823316552 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2800cb70 con 0x7fba4009fc60 2023-09-29T23:09:34.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.195+0000 7fba3dffb700 1 -- 172.21.15.115:0/3823316552 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2800f040 con 0x7fba4009fc60 2023-09-29T23:09:34.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.195+0000 7fba46ecb700 1 -- 172.21.15.115:0/3823316552 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba400ad7a0 con 0x7fba4009fc60 2023-09-29T23:09:34.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.195+0000 7fba3dffb700 1 -- 172.21.15.115:0/3823316552 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28014480 con 0x7fba4009fc60 2023-09-29T23:09:34.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.195+0000 7fba46ecb700 1 -- 172.21.15.115:0/3823316552 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba400ae5a0 con 0x7fba4009fc60 2023-09-29T23:09:34.201 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.195+0000 7fba46ecb700 1 -- 172.21.15.115:0/3823316552 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4004be00 con 0x7fba4009fc60 2023-09-29T23:09:34.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.199+0000 7fba3dffb700 1 -- 172.21.15.115:0/3823316552 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fba280147f0 con 0x7fba4009fc60 2023-09-29T23:09:34.203 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.199+0000 7fba3dffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:34.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.199+0000 7fba3dffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:34.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.199+0000 7fba3dffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:34.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.199+0000 7fba3dffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:34.205 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.199+0000 7fba3dffb700 1 --2- 172.21.15.115:0/3823316552 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fba2008e8b0 0x7fba20090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:34.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.199+0000 7fba456c8700 1 --2- 172.21.15.115:0/3823316552 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fba2008e8b0 0x7fba20090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:34.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.199+0000 7fba3dffb700 1 -- 172.21.15.115:0/3823316552 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fba280b5940 con 0x7fba4009fc60 2023-09-29T23:09:34.206 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.199+0000 7fba456c8700 1 --2- 172.21.15.115:0/3823316552 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fba2008e8b0 0x7fba20090d60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fba300030c0 tx=0x7fba30016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:34.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.207+0000 7fba3dffb700 1 -- 172.21.15.115:0/3823316552 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fba280862e0 con 0x7fba4009fc60 2023-09-29T23:09:34.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.403+0000 7fba46ecb700 1 -- 172.21.15.115:0/3823316552 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fba400b59e0 con 0x7fba4009fc60 2023-09-29T23:09:34.408 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.403+0000 7fba3dffb700 1 -- 172.21.15.115:0/3823316552 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fba28089900 con 0x7fba4009fc60 2023-09-29T23:09:34.408 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:34.408 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:34.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.403+0000 7fba46ecb700 10 mgrc shutdown 2023-09-29T23:09:34.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.403+0000 7fba46ecb700 1 -- 172.21.15.115:0/3823316552 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fba2008e8b0 msgr2=0x7fba20090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:34.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.403+0000 7fba46ecb700 1 --2- 172.21.15.115:0/3823316552 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fba2008e8b0 0x7fba20090d60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fba300030c0 tx=0x7fba30016000 comp rx=0 tx=0).stop 2023-09-29T23:09:34.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.403+0000 7fba46ecb700 1 -- 172.21.15.115:0/3823316552 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba4009fc60 msgr2=0x7fba400ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:34.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.403+0000 7fba46ecb700 1 --2- 172.21.15.115:0/3823316552 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba4009fc60 0x7fba400ad260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba28009ef0 tx=0x7fba2800b040 comp rx=0 tx=0).stop 2023-09-29T23:09:34.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.407+0000 7fba46ecb700 1 -- 172.21.15.115:0/3823316552 shutdown_connections 2023-09-29T23:09:34.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.407+0000 7fba46ecb700 1 --2- 172.21.15.115:0/3823316552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba40143a30 0x7fba4014f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:34.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.407+0000 7fba46ecb700 1 --2- 172.21.15.115:0/3823316552 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fba2008e8b0 0x7fba20090d60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:34.411 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.407+0000 7fba46ecb700 1 --2- 172.21.15.115:0/3823316552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba40142e50 0x7fba400aaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:34.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.407+0000 7fba46ecb700 1 --2- 172.21.15.115:0/3823316552 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fba4009fc60 0x7fba400ad260 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:34.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.407+0000 7fba46ecb700 1 -- 172.21.15.115:0/3823316552 >> 172.21.15.115:0/3823316552 conn(0x7fba400b6c10 msgr2=0x7fba400a8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:34.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.407+0000 7fba46ecb700 1 -- 172.21.15.115:0/3823316552 shutdown_connections 2023-09-29T23:09:34.412 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:34.407+0000 7fba46ecb700 1 -- 172.21.15.115:0/3823316552 wait complete. 2023-09-29T23:09:37.423 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:37.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.527+0000 7fc0461f0700 1 Processor -- start 2023-09-29T23:09:37.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.527+0000 7fc0461f0700 1 -- start start 2023-09-29T23:09:37.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0461f0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0400a32d0 0x7fc04009e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:37.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0461f0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0400a0f50 0x7fc040147090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:37.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0461f0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04013c680 con 0x7fc0400a36a0 2023-09-29T23:09:37.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0461f0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04013fd50 con 0x7fc0400a0f50 2023-09-29T23:09:37.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0461f0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04013fff0 con 0x7fc0400a32d0 2023-09-29T23:09:37.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0451ee700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0400a32d0 0x7fc04009e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:37.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0449ed700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc0400a36a0 0x7fc04009c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60048/0 (socket says 172.21.15.115:60048) 2023-09-29T23:09:37.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0449ed700 1 -- 172.21.15.115:0/448119496 learned_addr learned my addr 172.21.15.115:0/448119496 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:09:37.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0459ef700 1 --2- 172.21.15.115:0/448119496 >> v2:172.21.15.115:3300/0 conn(0x7fc0400a0f50 0x7fc040147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:37.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc037fff700 1 -- 172.21.15.115:0/448119496 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497515200 0 0) 0x7fc04013c680 con 0x7fc0400a36a0 2023-09-29T23:09:37.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0459ef700 1 -- 172.21.15.115:0/448119496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0400a32d0 msgr2=0x7fc04009e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:37.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0459ef700 1 --2- 172.21.15.115:0/448119496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0400a32d0 0x7fc04009e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:37.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0459ef700 1 -- 172.21.15.115:0/448119496 >> v1:172.21.15.115:6789/0 conn(0x7fc0400a36a0 legacy=0x7fc04009c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:37.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0459ef700 1 -- 172.21.15.115:0/448119496 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc040140290 con 0x7fc0400a0f50 2023-09-29T23:09:37.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0451ee700 1 --2- 172.21.15.115:0/448119496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0400a32d0 0x7fc04009e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:09:37.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0459ef700 1 --2- 172.21.15.115:0/448119496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0400a0f50 0x7fc040147090 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0098e0 tx=0x7fc03c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb981d61f1056820 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:37.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc037fff700 1 -- 172.21.15.115:0/448119496 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c00b640 con 0x7fc0400a0f50 2023-09-29T23:09:37.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc037fff700 1 -- 172.21.15.115:0/448119496 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c00b7a0 con 0x7fc0400a0f50 2023-09-29T23:09:37.538 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc037fff700 1 -- 172.21.15.115:0/448119496 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c00bb40 con 0x7fc0400a0f50 2023-09-29T23:09:37.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0461f0700 1 -- 172.21.15.115:0/448119496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0400a0f50 msgr2=0x7fc040147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:37.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0461f0700 1 --2- 172.21.15.115:0/448119496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0400a0f50 0x7fc040147090 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0098e0 tx=0x7fc03c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:09:37.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0461f0700 1 -- 172.21.15.115:0/448119496 shutdown_connections 2023-09-29T23:09:37.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0461f0700 1 --2- 172.21.15.115:0/448119496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0400a0f50 0x7fc040147090 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:37.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0461f0700 1 --2- 172.21.15.115:0/448119496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0400a32d0 0x7fc04009e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:37.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0461f0700 1 -- 172.21.15.115:0/448119496 >> 172.21.15.115:0/448119496 conn(0x7fc0400b1d20 msgr2=0x7fc0400b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:37.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0461f0700 1 -- 172.21.15.115:0/448119496 shutdown_connections 2023-09-29T23:09:37.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.531+0000 7fc0461f0700 1 -- 172.21.15.115:0/448119496 wait complete. 2023-09-29T23:09:37.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0461f0700 1 Processor -- start 2023-09-29T23:09:37.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0461f0700 1 -- start start 2023-09-29T23:09:37.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0461f0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0400a0f50 0x7fc04009eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:37.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0461f0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0400a32d0 0x7fc0400a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:37.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0461f0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0400a36a0 0x7fc040152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:37.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0461f0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04009f9f0 con 0x7fc0400a36a0 2023-09-29T23:09:37.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0461f0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04013ed80 con 0x7fc0400a0f50 2023-09-29T23:09:37.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0461f0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04013f040 con 0x7fc0400a32d0 2023-09-29T23:09:37.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0459ef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0400a36a0 0x7fc040152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:37.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0449ed700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0400a32d0 0x7fc0400a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:37.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0459ef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0400a36a0 0x7fc040152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58208/0 (socket says 172.21.15.115:58208) 2023-09-29T23:09:37.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0459ef700 1 -- 172.21.15.115:0/483506055 learned_addr learned my addr 172.21.15.115:0/483506055 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:37.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0451ee700 1 --2- 172.21.15.115:0/483506055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0400a0f50 0x7fc04009eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:37.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0459ef700 1 -- 172.21.15.115:0/483506055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0400a32d0 msgr2=0x7fc0400a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:37.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0459ef700 1 --2- 172.21.15.115:0/483506055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0400a32d0 0x7fc0400a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:37.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0459ef700 1 -- 172.21.15.115:0/483506055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0400a0f50 msgr2=0x7fc04009eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:37.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0459ef700 1 --2- 172.21.15.115:0/483506055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0400a0f50 0x7fc04009eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:37.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0459ef700 1 -- 172.21.15.115:0/483506055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc038009a20 con 0x7fc0400a36a0 2023-09-29T23:09:37.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0459ef700 1 --2- 172.21.15.115:0/483506055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0400a36a0 0x7fc040152a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc04006c1d0 tx=0x7fc03c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:37.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.535+0000 7fc0357fa700 1 -- 172.21.15.115:0/483506055 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c00bb20 con 0x7fc0400a36a0 2023-09-29T23:09:37.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.539+0000 7fc0357fa700 1 -- 172.21.15.115:0/483506055 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c011420 con 0x7fc0400a36a0 2023-09-29T23:09:37.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.539+0000 7fc0461f0700 1 -- 172.21.15.115:0/483506055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03c009420 con 0x7fc0400a36a0 2023-09-29T23:09:37.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.539+0000 7fc0357fa700 1 -- 172.21.15.115:0/483506055 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c0117a0 con 0x7fc0400a36a0 2023-09-29T23:09:37.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.539+0000 7fc0461f0700 1 -- 172.21.15.115:0/483506055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04013dd50 con 0x7fc0400a36a0 2023-09-29T23:09:37.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.539+0000 7fc0461f0700 1 -- 172.21.15.115:0/483506055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04004be00 con 0x7fc0400a36a0 2023-09-29T23:09:37.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.539+0000 7fc0357fa700 1 -- 172.21.15.115:0/483506055 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc03c011b10 con 0x7fc0400a36a0 2023-09-29T23:09:37.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.539+0000 7fc0357fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:37.546 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.543+0000 7fc0357fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:37.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.543+0000 7fc0357fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:37.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.543+0000 7fc0357fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:37.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.543+0000 7fc0357fa700 1 --2- 172.21.15.115:0/483506055 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc02408e8e0 0x7fc024090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:37.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.543+0000 7fc0357fa700 1 -- 172.21.15.115:0/483506055 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fc03c0b6380 con 0x7fc0400a36a0 2023-09-29T23:09:37.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.543+0000 7fc0451ee700 1 --2- 172.21.15.115:0/483506055 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc02408e8e0 0x7fc024090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:37.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.543+0000 7fc0451ee700 1 --2- 172.21.15.115:0/483506055 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc02408e8e0 0x7fc024090d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc038009fd0 tx=0x7fc03800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:37.550 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.547+0000 7fc0357fa700 1 -- 172.21.15.115:0/483506055 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc03c086db0 con 0x7fc0400a36a0 2023-09-29T23:09:37.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.739+0000 7fc0461f0700 1 -- 172.21.15.115:0/483506055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc0400a01d0 con 0x7fc0400a36a0 2023-09-29T23:09:37.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.739+0000 7fc0357fa700 1 -- 172.21.15.115:0/483506055 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fc03c08a3d0 con 0x7fc0400a36a0 2023-09-29T23:09:37.745 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:37.746 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:37.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.743+0000 7fc0461f0700 10 mgrc shutdown 2023-09-29T23:09:37.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.743+0000 7fc0461f0700 1 -- 172.21.15.115:0/483506055 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc02408e8e0 msgr2=0x7fc024090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:37.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.743+0000 7fc0461f0700 1 --2- 172.21.15.115:0/483506055 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc02408e8e0 0x7fc024090d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc038009fd0 tx=0x7fc03800b040 comp rx=0 tx=0).stop 2023-09-29T23:09:37.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.743+0000 7fc0461f0700 1 -- 172.21.15.115:0/483506055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0400a36a0 msgr2=0x7fc040152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:37.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.743+0000 7fc0461f0700 1 --2- 172.21.15.115:0/483506055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0400a36a0 0x7fc040152a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc04006c1d0 tx=0x7fc03c017000 comp rx=0 tx=0).stop 2023-09-29T23:09:37.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.743+0000 7fc0461f0700 1 -- 172.21.15.115:0/483506055 shutdown_connections 2023-09-29T23:09:37.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.743+0000 7fc0461f0700 1 --2- 172.21.15.115:0/483506055 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc02408e8e0 0x7fc024090d90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:37.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.743+0000 7fc0461f0700 1 --2- 172.21.15.115:0/483506055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0400a36a0 0x7fc040152a20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:37.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.743+0000 7fc0461f0700 1 --2- 172.21.15.115:0/483506055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0400a32d0 0x7fc0400a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:37.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.743+0000 7fc0461f0700 1 --2- 172.21.15.115:0/483506055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0400a0f50 0x7fc04009eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:37.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.743+0000 7fc0461f0700 1 -- 172.21.15.115:0/483506055 >> 172.21.15.115:0/483506055 conn(0x7fc0400b1d20 msgr2=0x7fc04013d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:37.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.743+0000 7fc0461f0700 1 -- 172.21.15.115:0/483506055 shutdown_connections 2023-09-29T23:09:37.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:37.743+0000 7fc0461f0700 1 -- 172.21.15.115:0/483506055 wait complete. 2023-09-29T23:09:39.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:09:39.291 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:09:40.760 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:40.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa358b18700 1 Processor -- start 2023-09-29T23:09:40.875 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa358b18700 1 -- start start 2023-09-29T23:09:40.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa358b18700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa35413b920 0x7fa35406e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:40.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa358b18700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35406d6d0 con 0x7fa3540a3630 2023-09-29T23:09:40.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa358b18700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3540688f0 con 0x7fa35406d300 2023-09-29T23:09:40.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa358b18700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa354068b60 con 0x7fa35413b920 2023-09-29T23:09:40.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa34affd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa3540a3630 0x7fa35413b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:60054/0 (socket says 172.21.15.115:60054) 2023-09-29T23:09:40.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa34affd700 1 -- 172.21.15.115:0/1003521262 learned_addr learned my addr 172.21.15.115:0/1003521262 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:09:40.877 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa353fff700 1 --2- 172.21.15.115:0/1003521262 >> v2:172.21.15.115:3300/0 conn(0x7fa35413b920 0x7fa35406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:40.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa352ffd700 1 -- 172.21.15.115:0/1003521262 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354119560 0 0) 0x7fa35406d6d0 con 0x7fa3540a3630 2023-09-29T23:09:40.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa352ffd700 1 -- 172.21.15.115:0/1003521262 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa340003570 con 0x7fa3540a3630 2023-09-29T23:09:40.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa352ffd700 1 -- 172.21.15.115:0/1003521262 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205868045 0 0) 0x7fa3540688f0 con 0x7fa35406d300 2023-09-29T23:09:40.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa353fff700 1 -- 172.21.15.115:0/1003521262 >> v1:172.21.15.156:6789/0 conn(0x7fa35406d300 legacy=0x7fa3540681e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:40.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa353fff700 1 -- 172.21.15.115:0/1003521262 >> v1:172.21.15.115:6789/0 conn(0x7fa3540a3630 legacy=0x7fa35413b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:40.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa353fff700 1 -- 172.21.15.115:0/1003521262 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa354068e20 con 0x7fa35413b920 2023-09-29T23:09:40.878 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa353fff700 1 --2- 172.21.15.115:0/1003521262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa35413b920 0x7fa35406e490 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009e60 tx=0x7fa34c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a3744679c1105f server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:40.879 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa352ffd700 1 -- 172.21.15.115:0/1003521262 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c00e070 con 0x7fa35413b920 2023-09-29T23:09:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa352ffd700 1 -- 172.21.15.115:0/1003521262 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c00bb60 con 0x7fa35413b920 2023-09-29T23:09:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa352ffd700 1 -- 172.21.15.115:0/1003521262 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c012430 con 0x7fa35413b920 2023-09-29T23:09:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa358b18700 1 -- 172.21.15.115:0/1003521262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa35413b920 msgr2=0x7fa35406e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa358b18700 1 --2- 172.21.15.115:0/1003521262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa35413b920 0x7fa35406e490 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009e60 tx=0x7fa34c009780 comp rx=0 tx=0).stop 2023-09-29T23:09:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa358b18700 1 -- 172.21.15.115:0/1003521262 shutdown_connections 2023-09-29T23:09:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa358b18700 1 --2- 172.21.15.115:0/1003521262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa35413b920 0x7fa35406e490 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa358b18700 1 -- 172.21.15.115:0/1003521262 >> 172.21.15.115:0/1003521262 conn(0x7fa3540a4af0 msgr2=0x7fa3540a2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa358b18700 1 -- 172.21.15.115:0/1003521262 shutdown_connections 2023-09-29T23:09:40.880 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.871+0000 7fa358b18700 1 -- 172.21.15.115:0/1003521262 wait complete. 2023-09-29T23:09:40.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa358b18700 1 Processor -- start 2023-09-29T23:09:40.881 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa358b18700 1 -- start start 2023-09-29T23:09:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa358b18700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa35406d300 0x7fa3540b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa358b18700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3540a3630 0x7fa3540b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa358b18700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa35413b920 0x7fa3541503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa358b18700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540b1730 con 0x7fa35406d300 2023-09-29T23:09:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa358b18700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35413ea10 con 0x7fa35413b920 2023-09-29T23:09:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa358b18700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35413ecd0 con 0x7fa3540a3630 2023-09-29T23:09:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa34affd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3540a3630 0x7fa3540b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa3537fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa35406d300 0x7fa3540b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:40.883 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa34affd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3540a3630 0x7fa3540b1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:57250/0 (socket says 172.21.15.115:57250) 2023-09-29T23:09:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa34affd700 1 -- 172.21.15.115:0/4181200349 learned_addr learned my addr 172.21.15.115:0/4181200349 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa3537fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa35406d300 0x7fa3540b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58222/0 (socket says 172.21.15.115:58222) 2023-09-29T23:09:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa353fff700 1 --2- 172.21.15.115:0/4181200349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa35413b920 0x7fa3541503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa3537fe700 1 -- 172.21.15.115:0/4181200349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3540a3630 msgr2=0x7fa3540b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa3537fe700 1 --2- 172.21.15.115:0/4181200349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3540a3630 0x7fa3540b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa3537fe700 1 -- 172.21.15.115:0/4181200349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa35413b920 msgr2=0x7fa3541503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa3537fe700 1 --2- 172.21.15.115:0/4181200349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa35413b920 0x7fa3541503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa3537fe700 1 -- 172.21.15.115:0/4181200349 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c009a20 con 0x7fa35406d300 2023-09-29T23:09:40.884 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa3537fe700 1 --2- 172.21.15.115:0/4181200349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa35406d300 0x7fa3540b0ab0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa3440011e0 tx=0x7fa344007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa34bfff700 1 -- 172.21.15.115:0/4181200349 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344011590 con 0x7fa35406d300 2023-09-29T23:09:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa34bfff700 1 -- 172.21.15.115:0/4181200349 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa344011710 con 0x7fa35406d300 2023-09-29T23:09:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa358b18700 1 -- 172.21.15.115:0/4181200349 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3541375b0 con 0x7fa35406d300 2023-09-29T23:09:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa34bfff700 1 -- 172.21.15.115:0/4181200349 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344011ad0 con 0x7fa35406d300 2023-09-29T23:09:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.875+0000 7fa358b18700 1 -- 172.21.15.115:0/4181200349 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35413e300 con 0x7fa35406d300 2023-09-29T23:09:40.885 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.879+0000 7fa358b18700 1 -- 172.21.15.115:0/4181200349 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3540a2b70 con 0x7fa35406d300 2023-09-29T23:09:40.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.879+0000 7fa34bfff700 1 -- 172.21.15.115:0/4181200349 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fa34401b3b0 con 0x7fa35406d300 2023-09-29T23:09:40.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.879+0000 7fa34bfff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:40.886 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.883+0000 7fa34bfff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:40.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.883+0000 7fa34bfff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:40.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.883+0000 7fa34bfff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:40.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.883+0000 7fa34bfff700 1 --2- 172.21.15.115:0/4181200349 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa33408e8b0 0x7fa334090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:40.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.883+0000 7fa34bfff700 1 -- 172.21.15.115:0/4181200349 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fa3440b3cc0 con 0x7fa35406d300 2023-09-29T23:09:40.887 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.883+0000 7fa34affd700 1 --2- 172.21.15.115:0/4181200349 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa33408e8b0 0x7fa334090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:40.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.883+0000 7fa34affd700 1 --2- 172.21.15.115:0/4181200349 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa33408e8b0 0x7fa334090d60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa35413f2c0 tx=0x7fa33c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:40.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:40.887+0000 7fa34bfff700 1 -- 172.21.15.115:0/4181200349 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa3540a2b70 con 0x7fa35406d300 2023-09-29T23:09:41.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.079+0000 7fa358b18700 1 -- 172.21.15.115:0/4181200349 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa3540a2b70 con 0x7fa35406d300 2023-09-29T23:09:41.084 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.079+0000 7fa34bfff700 1 -- 172.21.15.115:0/4181200349 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa3540a2b70 con 0x7fa35406d300 2023-09-29T23:09:41.085 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:41.085 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:41.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.079+0000 7fa358b18700 10 mgrc shutdown 2023-09-29T23:09:41.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.079+0000 7fa358b18700 1 -- 172.21.15.115:0/4181200349 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa33408e8b0 msgr2=0x7fa334090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:41.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.083+0000 7fa358b18700 1 --2- 172.21.15.115:0/4181200349 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa33408e8b0 0x7fa334090d60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa35413f2c0 tx=0x7fa33c009040 comp rx=0 tx=0).stop 2023-09-29T23:09:41.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.083+0000 7fa358b18700 1 -- 172.21.15.115:0/4181200349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa35406d300 msgr2=0x7fa3540b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:41.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.083+0000 7fa358b18700 1 --2- 172.21.15.115:0/4181200349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa35406d300 0x7fa3540b0ab0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa3440011e0 tx=0x7fa344007d30 comp rx=0 tx=0).stop 2023-09-29T23:09:41.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.083+0000 7fa358b18700 1 -- 172.21.15.115:0/4181200349 shutdown_connections 2023-09-29T23:09:41.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.083+0000 7fa358b18700 1 --2- 172.21.15.115:0/4181200349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa35413b920 0x7fa3541503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:41.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.083+0000 7fa358b18700 1 --2- 172.21.15.115:0/4181200349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3540a3630 0x7fa3540b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:41.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.083+0000 7fa358b18700 1 --2- 172.21.15.115:0/4181200349 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa33408e8b0 0x7fa334090d60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:41.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.083+0000 7fa358b18700 1 --2- 172.21.15.115:0/4181200349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa35406d300 0x7fa3540b0ab0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:41.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.083+0000 7fa358b18700 1 -- 172.21.15.115:0/4181200349 >> 172.21.15.115:0/4181200349 conn(0x7fa3540a4af0 msgr2=0x7fa35413afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:41.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.083+0000 7fa358b18700 1 -- 172.21.15.115:0/4181200349 shutdown_connections 2023-09-29T23:09:41.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:41.083+0000 7fa358b18700 1 -- 172.21.15.115:0/4181200349 wait complete. 2023-09-29T23:09:44.099 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:44.210 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.203+0000 7fa6e7fff700 1 Processor -- start 2023-09-29T23:09:44.211 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e7fff700 1 -- start start 2023-09-29T23:09:44.212 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e7fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa6e8142e50 0x7fa6e81434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:44.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8143a30 0x7fa6e813fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:44.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e7fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e80a0030 con 0x7fa6e809fc60 2023-09-29T23:09:44.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e7fff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e813fb70 con 0x7fa6e8142e50 2023-09-29T23:09:44.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e7fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e813f8d0 con 0x7fa6e8143a30 2023-09-29T23:09:44.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8143a30 0x7fa6e813fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:44.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6dffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa6e809fc60 0x7fa6e80a1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40826/0 (socket says 172.21.15.115:40826) 2023-09-29T23:09:44.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6dffff700 1 -- 172.21.15.115:0/337418131 learned_addr learned my addr 172.21.15.115:0/337418131 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:09:44.213 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e6ffd700 1 --2- 172.21.15.115:0/337418131 >> v2:172.21.15.156:3300/0 conn(0x7fa6e8142e50 0x7fa6e81434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:44.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e67fc700 1 -- 172.21.15.115:0/337418131 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506857412 0 0) 0x7fa6e80a0030 con 0x7fa6e809fc60 2023-09-29T23:09:44.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e67fc700 1 -- 172.21.15.115:0/337418131 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d4003570 con 0x7fa6e809fc60 2023-09-29T23:09:44.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e77fe700 1 -- 172.21.15.115:0/337418131 >> v2:172.21.15.156:3300/0 conn(0x7fa6e8142e50 msgr2=0x7fa6e81434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:44.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e77fe700 1 --2- 172.21.15.115:0/337418131 >> v2:172.21.15.156:3300/0 conn(0x7fa6e8142e50 0x7fa6e81434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:44.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e77fe700 1 -- 172.21.15.115:0/337418131 >> v1:172.21.15.115:6789/0 conn(0x7fa6e809fc60 legacy=0x7fa6e80a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:44.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e77fe700 1 -- 172.21.15.115:0/337418131 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e8140350 con 0x7fa6e8143a30 2023-09-29T23:09:44.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e77fe700 1 --2- 172.21.15.115:0/337418131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8143a30 0x7fa6e813fe10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009e60 tx=0x7fa6e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b4fb211ad2a1377 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:44.215 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e67fc700 1 -- 172.21.15.115:0/337418131 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e000e070 con 0x7fa6e8143a30 2023-09-29T23:09:44.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e67fc700 1 -- 172.21.15.115:0/337418131 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e000bab0 con 0x7fa6e8143a30 2023-09-29T23:09:44.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.207+0000 7fa6e67fc700 1 -- 172.21.15.115:0/337418131 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e000be30 con 0x7fa6e8143a30 2023-09-29T23:09:44.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 -- 172.21.15.115:0/337418131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8143a30 msgr2=0x7fa6e813fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:44.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 --2- 172.21.15.115:0/337418131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8143a30 0x7fa6e813fe10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009e60 tx=0x7fa6e0009780 comp rx=0 tx=0).stop 2023-09-29T23:09:44.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 -- 172.21.15.115:0/337418131 shutdown_connections 2023-09-29T23:09:44.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 --2- 172.21.15.115:0/337418131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e8143a30 0x7fa6e813fe10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:44.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 --2- 172.21.15.115:0/337418131 >> v2:172.21.15.156:3300/0 conn(0x7fa6e8142e50 0x7fa6e81434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:44.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 -- 172.21.15.115:0/337418131 >> 172.21.15.115:0/337418131 conn(0x7fa6e80b6c10 msgr2=0x7fa6e8067bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:44.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 -- 172.21.15.115:0/337418131 shutdown_connections 2023-09-29T23:09:44.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 -- 172.21.15.115:0/337418131 wait complete. 2023-09-29T23:09:44.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 Processor -- start 2023-09-29T23:09:44.217 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 -- start start 2023-09-29T23:09:44.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e809fc60 0x7fa6e813e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:44.219 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e8142e50 0x7fa6e813cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e8143a30 0x7fa6e813d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e813f730 con 0x7fa6e8142e50 2023-09-29T23:09:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e8097b90 con 0x7fa6e8143a30 2023-09-29T23:09:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e7fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e813ea40 con 0x7fa6e809fc60 2023-09-29T23:09:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6dffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e809fc60 0x7fa6e813e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e6ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e8142e50 0x7fa6e813cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6dffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e809fc60 0x7fa6e813e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:54518/0 (socket says 172.21.15.115:54518) 2023-09-29T23:09:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6dffff700 1 -- 172.21.15.115:0/1740909844 learned_addr learned my addr 172.21.15.115:0/1740909844 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:44.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.211+0000 7fa6e77fe700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e8143a30 0x7fa6e813d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.215+0000 7fa6dffff700 1 -- 172.21.15.115:0/1740909844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e8143a30 msgr2=0x7fa6e813d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.215+0000 7fa6dffff700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e8143a30 0x7fa6e813d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.215+0000 7fa6dffff700 1 -- 172.21.15.115:0/1740909844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e8142e50 msgr2=0x7fa6e813cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.215+0000 7fa6dffff700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e8142e50 0x7fa6e813cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.215+0000 7fa6dffff700 1 -- 172.21.15.115:0/1740909844 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e0009a20 con 0x7fa6e809fc60 2023-09-29T23:09:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.215+0000 7fa6e6ffd700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e8142e50 0x7fa6e813cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:09:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.215+0000 7fa6dffff700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e809fc60 0x7fa6e813e1c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80011e0 tx=0x7fa6d8007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.215+0000 7fa6deffd700 1 -- 172.21.15.115:0/1740909844 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8005b30 con 0x7fa6e809fc60 2023-09-29T23:09:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.215+0000 7fa6deffd700 1 -- 172.21.15.115:0/1740909844 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d8005c90 con 0x7fa6e809fc60 2023-09-29T23:09:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.215+0000 7fa6e7fff700 1 -- 172.21.15.115:0/1740909844 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e813ece0 con 0x7fa6e809fc60 2023-09-29T23:09:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.215+0000 7fa6deffd700 1 -- 172.21.15.115:0/1740909844 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8007300 con 0x7fa6e809fc60 2023-09-29T23:09:44.221 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.215+0000 7fa6e7fff700 1 -- 172.21.15.115:0/1740909844 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e813e780 con 0x7fa6e809fc60 2023-09-29T23:09:44.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.215+0000 7fa6e7fff700 1 -- 172.21.15.115:0/1740909844 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e804be00 con 0x7fa6e809fc60 2023-09-29T23:09:44.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.219+0000 7fa6deffd700 1 -- 172.21.15.115:0/1740909844 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fa6d8007670 con 0x7fa6e809fc60 2023-09-29T23:09:44.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.219+0000 7fa6deffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:44.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.219+0000 7fa6deffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:44.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.219+0000 7fa6deffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:44.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.219+0000 7fa6deffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:44.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.219+0000 7fa6deffd700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa6c808e8e0 0x7fa6c8090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:44.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.219+0000 7fa6deffd700 1 -- 172.21.15.115:0/1740909844 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fa6d80b40b0 con 0x7fa6e809fc60 2023-09-29T23:09:44.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.219+0000 7fa6e6ffd700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa6c808e8e0 0x7fa6c8090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:44.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.219+0000 7fa6e6ffd700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa6c808e8e0 0x7fa6c8090d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0011480 tx=0x7fa6d00091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:44.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.223+0000 7fa6deffd700 1 -- 172.21.15.115:0/1740909844 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa6d8084a50 con 0x7fa6e809fc60 2023-09-29T23:09:44.420 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.415+0000 7fa6e7fff700 1 -- 172.21.15.115:0/1740909844 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa6e81406b0 con 0x7fa6e809fc60 2023-09-29T23:09:44.421 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.415+0000 7fa6deffd700 1 -- 172.21.15.115:0/1740909844 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa6d8017020 con 0x7fa6e809fc60 2023-09-29T23:09:44.421 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:44.421 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:44.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.419+0000 7fa6e7fff700 10 mgrc shutdown 2023-09-29T23:09:44.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.419+0000 7fa6e7fff700 1 -- 172.21.15.115:0/1740909844 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa6c808e8e0 msgr2=0x7fa6c8090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:44.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.419+0000 7fa6e7fff700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa6c808e8e0 0x7fa6c8090d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0011480 tx=0x7fa6d00091a0 comp rx=0 tx=0).stop 2023-09-29T23:09:44.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.419+0000 7fa6e7fff700 1 -- 172.21.15.115:0/1740909844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e809fc60 msgr2=0x7fa6e813e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:44.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.419+0000 7fa6e7fff700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e809fc60 0x7fa6e813e1c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80011e0 tx=0x7fa6d8007df0 comp rx=0 tx=0).stop 2023-09-29T23:09:44.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.419+0000 7fa6e7fff700 1 -- 172.21.15.115:0/1740909844 shutdown_connections 2023-09-29T23:09:44.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.419+0000 7fa6e7fff700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6e8143a30 0x7fa6e813d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:44.424 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.419+0000 7fa6e7fff700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fa6c808e8e0 0x7fa6c8090d90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:44.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.419+0000 7fa6e7fff700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6e8142e50 0x7fa6e813cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:44.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.419+0000 7fa6e7fff700 1 --2- 172.21.15.115:0/1740909844 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6e809fc60 0x7fa6e813e1c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:44.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.419+0000 7fa6e7fff700 1 -- 172.21.15.115:0/1740909844 >> 172.21.15.115:0/1740909844 conn(0x7fa6e80b6c10 msgr2=0x7fa6e80a70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:44.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.419+0000 7fa6e7fff700 1 -- 172.21.15.115:0/1740909844 shutdown_connections 2023-09-29T23:09:44.425 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:44.419+0000 7fa6e7fff700 1 -- 172.21.15.115:0/1740909844 wait complete. 2023-09-29T23:09:47.437 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:47.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.539+0000 7fef99734700 1 Processor -- start 2023-09-29T23:09:47.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef99734700 1 -- start start 2023-09-29T23:09:47.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef99734700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fef94143270 0x7fef941436d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:47.548 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef99734700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef940a4830 con 0x7fef94067b60 2023-09-29T23:09:47.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef99734700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef94067f30 con 0x7fef9406e860 2023-09-29T23:09:47.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef99734700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9406fa30 con 0x7fef94143270 2023-09-29T23:09:47.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef98f33700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fef94143270 0x7fef941436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:47.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef93fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fef94067b60 0x7fef940a3e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40838/0 (socket says 172.21.15.115:40838) 2023-09-29T23:09:47.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef98f33700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fef94143270 0x7fef941436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41640/0 (socket says 172.21.15.115:41640) 2023-09-29T23:09:47.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef93fff700 1 -- 172.21.15.115:0/3111894908 learned_addr learned my addr 172.21.15.115:0/3111894908 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:09:47.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef98f33700 1 -- 172.21.15.115:0/3111894908 >> v1:172.21.15.156:6789/0 conn(0x7fef9406e860 legacy=0x7fef9406ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:47.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef98f33700 1 -- 172.21.15.115:0/3111894908 >> v1:172.21.15.115:6789/0 conn(0x7fef94067b60 legacy=0x7fef940a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:47.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef937fe700 1 -- 172.21.15.115:0/3111894908 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890357574 0 0) 0x7fef940a4830 con 0x7fef94067b60 2023-09-29T23:09:47.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef98f33700 1 -- 172.21.15.115:0/3111894908 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9406e410 con 0x7fef94143270 2023-09-29T23:09:47.549 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef98f33700 1 --2- 172.21.15.115:0/3111894908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef94143270 0x7fef941436d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009e60 tx=0x7fef8c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4ed80d735bc63a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:47.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef937fe700 1 -- 172.21.15.115:0/3111894908 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c00e070 con 0x7fef94143270 2023-09-29T23:09:47.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef937fe700 1 -- 172.21.15.115:0/3111894908 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c00bc30 con 0x7fef94143270 2023-09-29T23:09:47.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef937fe700 1 -- 172.21.15.115:0/3111894908 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c012430 con 0x7fef94143270 2023-09-29T23:09:47.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef99734700 1 -- 172.21.15.115:0/3111894908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef94143270 msgr2=0x7fef941436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:47.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef99734700 1 --2- 172.21.15.115:0/3111894908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef94143270 0x7fef941436d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009e60 tx=0x7fef8c009780 comp rx=0 tx=0).stop 2023-09-29T23:09:47.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef99734700 1 -- 172.21.15.115:0/3111894908 shutdown_connections 2023-09-29T23:09:47.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef99734700 1 --2- 172.21.15.115:0/3111894908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef94143270 0x7fef941436d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:47.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef99734700 1 -- 172.21.15.115:0/3111894908 >> 172.21.15.115:0/3111894908 conn(0x7fef94068a40 msgr2=0x7fef94068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:47.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef99734700 1 -- 172.21.15.115:0/3111894908 shutdown_connections 2023-09-29T23:09:47.551 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.543+0000 7fef99734700 1 -- 172.21.15.115:0/3111894908 wait complete. 2023-09-29T23:09:47.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef99734700 1 Processor -- start 2023-09-29T23:09:47.552 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef99734700 1 -- start start 2023-09-29T23:09:47.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef99734700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef94067b60 0x7fef9409b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:47.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef99734700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef9406e860 0x7fef940a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:47.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef99734700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef94143270 0x7fef940a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:47.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef99734700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef940a2080 con 0x7fef94143270 2023-09-29T23:09:47.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef99734700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef94098e10 con 0x7fef9406e860 2023-09-29T23:09:47.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef99734700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9409aac0 con 0x7fef94067b60 2023-09-29T23:09:47.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef93fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef94067b60 0x7fef9409b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:47.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef98f33700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef94143270 0x7fef940a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:47.554 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef93fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef94067b60 0x7fef9409b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:54532/0 (socket says 172.21.15.115:54532) 2023-09-29T23:09:47.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef93fff700 1 -- 172.21.15.115:0/3270157681 learned_addr learned my addr 172.21.15.115:0/3270157681 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:47.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef8b7fe700 1 --2- 172.21.15.115:0/3270157681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef9406e860 0x7fef940a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:47.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef93fff700 1 -- 172.21.15.115:0/3270157681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef9406e860 msgr2=0x7fef940a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:47.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef93fff700 1 --2- 172.21.15.115:0/3270157681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef9406e860 0x7fef940a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:47.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef93fff700 1 -- 172.21.15.115:0/3270157681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef94143270 msgr2=0x7fef940a1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:47.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef93fff700 1 --2- 172.21.15.115:0/3270157681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef94143270 0x7fef940a1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:47.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef93fff700 1 -- 172.21.15.115:0/3270157681 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c009a20 con 0x7fef94067b60 2023-09-29T23:09:47.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef93fff700 1 --2- 172.21.15.115:0/3270157681 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef94067b60 0x7fef9409b740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fef8400c7e0 tx=0x7fef84007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:47.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef90ff9700 1 -- 172.21.15.115:0/3270157681 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef84005b30 con 0x7fef94067b60 2023-09-29T23:09:47.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef90ff9700 1 -- 172.21.15.115:0/3270157681 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef84005c90 con 0x7fef94067b60 2023-09-29T23:09:47.555 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef99734700 1 -- 172.21.15.115:0/3270157681 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef941355e0 con 0x7fef94067b60 2023-09-29T23:09:47.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef90ff9700 1 -- 172.21.15.115:0/3270157681 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef84007300 con 0x7fef94067b60 2023-09-29T23:09:47.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.547+0000 7fef99734700 1 -- 172.21.15.115:0/3270157681 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9409ad10 con 0x7fef94067b60 2023-09-29T23:09:47.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.551+0000 7fef99734700 1 -- 172.21.15.115:0/3270157681 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9404be00 con 0x7fef94067b60 2023-09-29T23:09:47.557 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.551+0000 7fef90ff9700 1 -- 172.21.15.115:0/3270157681 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fef840076b0 con 0x7fef94067b60 2023-09-29T23:09:47.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.551+0000 7fef90ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:47.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.551+0000 7fef90ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:47.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.551+0000 7fef90ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:47.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.551+0000 7fef90ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:47.558 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.551+0000 7fef90ff9700 1 --2- 172.21.15.115:0/3270157681 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef7408e8e0 0x7fef74090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:47.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.555+0000 7fef90ff9700 1 -- 172.21.15.115:0/3270157681 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fef840b3c10 con 0x7fef94067b60 2023-09-29T23:09:47.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.555+0000 7fef8b7fe700 1 --2- 172.21.15.115:0/3270157681 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef7408e8e0 0x7fef74090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:47.559 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.555+0000 7fef8b7fe700 1 --2- 172.21.15.115:0/3270157681 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef7408e8e0 0x7fef74090d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef94142eb0 tx=0x7fef7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:47.564 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.559+0000 7fef90ff9700 1 -- 172.21.15.115:0/3270157681 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fef840845b0 con 0x7fef94067b60 2023-09-29T23:09:47.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.755+0000 7fef99734700 1 -- 172.21.15.115:0/3270157681 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fef94135580 con 0x7fef94067b60 2023-09-29T23:09:47.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef90ff9700 1 -- 172.21.15.115:0/3270157681 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fef84017080 con 0x7fef94067b60 2023-09-29T23:09:47.763 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:47.763 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef99734700 10 mgrc shutdown 2023-09-29T23:09:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef99734700 1 -- 172.21.15.115:0/3270157681 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef7408e8e0 msgr2=0x7fef74090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef99734700 1 --2- 172.21.15.115:0/3270157681 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef7408e8e0 0x7fef74090d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef94142eb0 tx=0x7fef7c009040 comp rx=0 tx=0).stop 2023-09-29T23:09:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef99734700 1 -- 172.21.15.115:0/3270157681 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef94067b60 msgr2=0x7fef9409b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef99734700 1 --2- 172.21.15.115:0/3270157681 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef94067b60 0x7fef9409b740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fef8400c7e0 tx=0x7fef84007df0 comp rx=0 tx=0).stop 2023-09-29T23:09:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef99734700 1 -- 172.21.15.115:0/3270157681 shutdown_connections 2023-09-29T23:09:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef99734700 1 --2- 172.21.15.115:0/3270157681 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fef7408e8e0 0x7fef74090d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:47.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef99734700 1 --2- 172.21.15.115:0/3270157681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef94143270 0x7fef940a1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:47.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef99734700 1 --2- 172.21.15.115:0/3270157681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef9406e860 0x7fef940a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:47.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef99734700 1 --2- 172.21.15.115:0/3270157681 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef94067b60 0x7fef9409b740 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:47.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef99734700 1 -- 172.21.15.115:0/3270157681 >> 172.21.15.115:0/3270157681 conn(0x7fef94068a40 msgr2=0x7fef9406ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:47.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef99734700 1 -- 172.21.15.115:0/3270157681 shutdown_connections 2023-09-29T23:09:47.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:47.759+0000 7fef99734700 1 -- 172.21.15.115:0/3270157681 wait complete. 2023-09-29T23:09:50.778 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:50.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff848ec4700 1 Processor -- start 2023-09-29T23:09:50.888 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff848ec4700 1 -- start start 2023-09-29T23:09:50.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff848ec4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff84409fc60 0x7ff8440a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:50.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff848ec4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8440a0030 con 0x7ff84413fe10 2023-09-29T23:09:50.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff848ec4700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8440a1ac0 con 0x7ff844142e50 2023-09-29T23:09:50.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff848ec4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84413fb70 con 0x7ff84409fc60 2023-09-29T23:09:50.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff8437fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff84409fc60 0x7ff8440a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:50.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff843fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff84413fe10 0x7ff844140250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:40842/0 (socket says 172.21.15.115:40842) 2023-09-29T23:09:50.889 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff843fff700 1 -- 172.21.15.115:0/1506529741 learned_addr learned my addr 172.21.15.115:0/1506529741 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:09:50.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff8427fc700 1 -- 172.21.15.115:0/1506529741 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683172128 0 0) 0x7ff8440a0030 con 0x7ff84413fe10 2023-09-29T23:09:50.890 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff8427fc700 1 -- 172.21.15.115:0/1506529741 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff824003570 con 0x7ff84413fe10 2023-09-29T23:09:50.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff8437fe700 1 -- 172.21.15.115:0/1506529741 >> v1:172.21.15.156:6789/0 conn(0x7ff844142e50 legacy=0x7ff8441434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:50.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff8437fe700 1 -- 172.21.15.115:0/1506529741 >> v1:172.21.15.115:6789/0 conn(0x7ff84413fe10 legacy=0x7ff844140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:50.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff8437fe700 1 -- 172.21.15.115:0/1506529741 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84413f8d0 con 0x7ff84409fc60 2023-09-29T23:09:50.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff8437fe700 1 --2- 172.21.15.115:0/1506529741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff84409fc60 0x7ff8440a1580 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff8340098e0 tx=0x7ff8340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88aeeec806c3b58f server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:50.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff8427fc700 1 -- 172.21.15.115:0/1506529741 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400b640 con 0x7ff84409fc60 2023-09-29T23:09:50.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff8427fc700 1 -- 172.21.15.115:0/1506529741 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83400b7a0 con 0x7ff84409fc60 2023-09-29T23:09:50.891 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.883+0000 7ff8427fc700 1 -- 172.21.15.115:0/1506529741 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400bb20 con 0x7ff84409fc60 2023-09-29T23:09:50.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 -- 172.21.15.115:0/1506529741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff84409fc60 msgr2=0x7ff8440a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:50.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 --2- 172.21.15.115:0/1506529741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff84409fc60 0x7ff8440a1580 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff8340098e0 tx=0x7ff8340091a0 comp rx=0 tx=0).stop 2023-09-29T23:09:50.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 -- 172.21.15.115:0/1506529741 shutdown_connections 2023-09-29T23:09:50.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 --2- 172.21.15.115:0/1506529741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff84409fc60 0x7ff8440a1580 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:50.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 -- 172.21.15.115:0/1506529741 >> 172.21.15.115:0/1506529741 conn(0x7ff8440b6c10 msgr2=0x7ff844067bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:50.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 -- 172.21.15.115:0/1506529741 shutdown_connections 2023-09-29T23:09:50.892 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 -- 172.21.15.115:0/1506529741 wait complete. 2023-09-29T23:09:50.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 Processor -- start 2023-09-29T23:09:50.893 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 -- start start 2023-09-29T23:09:50.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff84409fc60 0x7ff84413c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:50.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff84413fe10 0x7ff844145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:50.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff844142e50 0x7ff844144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:50.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844145560 con 0x7ff84413fe10 2023-09-29T23:09:50.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84413d9e0 con 0x7ff84409fc60 2023-09-29T23:09:50.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff848ec4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84413c8a0 con 0x7ff844142e50 2023-09-29T23:09:50.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff842ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff84413fe10 0x7ff844145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:50.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff843fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff844142e50 0x7ff844144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:50.894 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff842ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff84413fe10 0x7ff844145f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41666/0 (socket says 172.21.15.115:41666) 2023-09-29T23:09:50.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff843fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff844142e50 0x7ff844144140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:54548/0 (socket says 172.21.15.115:54548) 2023-09-29T23:09:50.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff842ffd700 1 -- 172.21.15.115:0/2266599648 learned_addr learned my addr 172.21.15.115:0/2266599648 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:50.895 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff8437fe700 1 --2- 172.21.15.115:0/2266599648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff84409fc60 0x7ff84413c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:50.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff843fff700 1 -- 172.21.15.115:0/2266599648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff84409fc60 msgr2=0x7ff84413c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:50.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff843fff700 1 --2- 172.21.15.115:0/2266599648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff84409fc60 0x7ff84413c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:50.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff843fff700 1 -- 172.21.15.115:0/2266599648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff84413fe10 msgr2=0x7ff844145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:50.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff843fff700 1 --2- 172.21.15.115:0/2266599648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff84413fe10 0x7ff844145f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:50.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.887+0000 7ff843fff700 1 -- 172.21.15.115:0/2266599648 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834009420 con 0x7ff844142e50 2023-09-29T23:09:50.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff843fff700 1 --2- 172.21.15.115:0/2266599648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff844142e50 0x7ff844144140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00cbc0 tx=0x7ff83c001a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:50.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff83b7fe700 1 -- 172.21.15.115:0/2266599648 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00a870 con 0x7ff844142e50 2023-09-29T23:09:50.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff83b7fe700 1 -- 172.21.15.115:0/2266599648 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00a9d0 con 0x7ff844142e50 2023-09-29T23:09:50.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff848ec4700 1 -- 172.21.15.115:0/2266599648 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84413cb60 con 0x7ff844142e50 2023-09-29T23:09:50.896 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff83b7fe700 1 -- 172.21.15.115:0/2266599648 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00ad50 con 0x7ff844142e50 2023-09-29T23:09:50.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff848ec4700 1 -- 172.21.15.115:0/2266599648 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84413e060 con 0x7ff844142e50 2023-09-29T23:09:50.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff848ec4700 1 -- 172.21.15.115:0/2266599648 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84404be00 con 0x7ff844142e50 2023-09-29T23:09:50.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff83b7fe700 1 -- 172.21.15.115:0/2266599648 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7ff83c007300 con 0x7ff844142e50 2023-09-29T23:09:50.897 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff83b7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:50.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff83b7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:50.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff83b7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:50.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff83b7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:50.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff83b7fe700 1 --2- 172.21.15.115:0/2266599648 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff82808e8b0 0x7ff828090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:50.898 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff83b7fe700 1 -- 172.21.15.115:0/2266599648 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7ff83c0b4ca0 con 0x7ff844142e50 2023-09-29T23:09:50.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.891+0000 7ff8437fe700 1 --2- 172.21.15.115:0/2266599648 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff82808e8b0 0x7ff828090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:50.899 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.895+0000 7ff8437fe700 1 --2- 172.21.15.115:0/2266599648 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff82808e8b0 0x7ff828090d60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff8340091e0 tx=0x7ff834017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:50.906 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:50.899+0000 7ff83b7fe700 1 -- 172.21.15.115:0/2266599648 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff83c0855b0 con 0x7ff844142e50 2023-09-29T23:09:51.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.095+0000 7ff848ec4700 1 -- 172.21.15.115:0/2266599648 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff8440b5a70 con 0x7ff844142e50 2023-09-29T23:09:51.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.095+0000 7ff83b7fe700 1 -- 172.21.15.115:0/2266599648 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff83c0874e0 con 0x7ff844142e50 2023-09-29T23:09:51.100 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:51.100 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:51.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.099+0000 7ff848ec4700 10 mgrc shutdown 2023-09-29T23:09:51.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.099+0000 7ff848ec4700 1 -- 172.21.15.115:0/2266599648 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff82808e8b0 msgr2=0x7ff828090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:51.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.099+0000 7ff848ec4700 1 --2- 172.21.15.115:0/2266599648 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff82808e8b0 0x7ff828090d60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff8340091e0 tx=0x7ff834017000 comp rx=0 tx=0).stop 2023-09-29T23:09:51.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.099+0000 7ff848ec4700 1 -- 172.21.15.115:0/2266599648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff844142e50 msgr2=0x7ff844144140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:51.104 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.099+0000 7ff848ec4700 1 --2- 172.21.15.115:0/2266599648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff844142e50 0x7ff844144140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00cbc0 tx=0x7ff83c001a20 comp rx=0 tx=0).stop 2023-09-29T23:09:51.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.099+0000 7ff848ec4700 1 -- 172.21.15.115:0/2266599648 shutdown_connections 2023-09-29T23:09:51.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.099+0000 7ff848ec4700 1 --2- 172.21.15.115:0/2266599648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff844142e50 0x7ff844144140 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:51.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.099+0000 7ff848ec4700 1 --2- 172.21.15.115:0/2266599648 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff82808e8b0 0x7ff828090d60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:51.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.099+0000 7ff848ec4700 1 --2- 172.21.15.115:0/2266599648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff84413fe10 0x7ff844145f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:51.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.099+0000 7ff848ec4700 1 --2- 172.21.15.115:0/2266599648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff84409fc60 0x7ff84413c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:51.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.099+0000 7ff848ec4700 1 -- 172.21.15.115:0/2266599648 >> 172.21.15.115:0/2266599648 conn(0x7ff8440b6c10 msgr2=0x7ff84413f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:51.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.099+0000 7ff848ec4700 1 -- 172.21.15.115:0/2266599648 shutdown_connections 2023-09-29T23:09:51.105 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:51.099+0000 7ff848ec4700 1 -- 172.21.15.115:0/2266599648 wait complete. 2023-09-29T23:09:54.118 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:54.228 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc834827700 1 Processor -- start 2023-09-29T23:09:54.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc834827700 1 -- start start 2023-09-29T23:09:54.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc834827700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc83009d320 0x7fc8300a4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:54.229 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc834827700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc83013fb10 0x7fc83013ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:54.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc834827700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83009ce00 con 0x7fc830067b60 2023-09-29T23:09:54.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc834827700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83009c630 con 0x7fc83009d320 2023-09-29T23:09:54.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc834827700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc830067f30 con 0x7fc83013fb10 2023-09-29T23:09:54.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc82f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc83013fb10 0x7fc83013ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:54.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc82f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc83013fb10 0x7fc83013ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:34432/0 (socket says 172.21.15.115:34432) 2023-09-29T23:09:54.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc82f59e700 1 -- 172.21.15.115:0/1979931444 learned_addr learned my addr 172.21.15.115:0/1979931444 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:54.230 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc82e59c700 1 --2- 172.21.15.115:0/1979931444 >> v2:172.21.15.156:3300/0 conn(0x7fc83009d320 0x7fc8300a4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc82dd9b700 1 -- 172.21.15.115:0/1979931444 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178037066 0 0) 0x7fc83009ce00 con 0x7fc830067b60 2023-09-29T23:09:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc82dd9b700 1 -- 172.21.15.115:0/1979931444 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc818003570 con 0x7fc830067b60 2023-09-29T23:09:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc82f59e700 1 -- 172.21.15.115:0/1979931444 >> v2:172.21.15.156:3300/0 conn(0x7fc83009d320 msgr2=0x7fc8300a4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc82f59e700 1 --2- 172.21.15.115:0/1979931444 >> v2:172.21.15.156:3300/0 conn(0x7fc83009d320 0x7fc8300a4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc82f59e700 1 -- 172.21.15.115:0/1979931444 >> v1:172.21.15.156:6789/0 conn(0x7fc830067b60 legacy=0x7fc83009bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.222+0000 7fc82f59e700 1 -- 172.21.15.115:0/1979931444 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83009d6f0 con 0x7fc83013fb10 2023-09-29T23:09:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc82f59e700 1 --2- 172.21.15.115:0/1979931444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc83013fb10 0x7fc83013ff50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc8280099b0 tx=0x7fc828009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce1ac50cc695bf03 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc82dd9b700 1 -- 172.21.15.115:0/1979931444 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82800b680 con 0x7fc83013fb10 2023-09-29T23:09:54.232 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc82dd9b700 1 -- 172.21.15.115:0/1979931444 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82800b7e0 con 0x7fc83013fb10 2023-09-29T23:09:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc82dd9b700 1 -- 172.21.15.115:0/1979931444 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82800bb80 con 0x7fc83013fb10 2023-09-29T23:09:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc834827700 1 -- 172.21.15.115:0/1979931444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc83013fb10 msgr2=0x7fc83013ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc834827700 1 --2- 172.21.15.115:0/1979931444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc83013fb10 0x7fc83013ff50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc8280099b0 tx=0x7fc828009250 comp rx=0 tx=0).stop 2023-09-29T23:09:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc834827700 1 -- 172.21.15.115:0/1979931444 shutdown_connections 2023-09-29T23:09:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc834827700 1 --2- 172.21.15.115:0/1979931444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc83013fb10 0x7fc83013ff50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc834827700 1 --2- 172.21.15.115:0/1979931444 >> v2:172.21.15.156:3300/0 conn(0x7fc83009d320 0x7fc8300a4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc834827700 1 -- 172.21.15.115:0/1979931444 >> 172.21.15.115:0/1979931444 conn(0x7fc8300b1d20 msgr2=0x7fc8300b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc834827700 1 -- 172.21.15.115:0/1979931444 shutdown_connections 2023-09-29T23:09:54.233 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc834827700 1 -- 172.21.15.115:0/1979931444 wait complete. 2023-09-29T23:09:54.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc834827700 1 Processor -- start 2023-09-29T23:09:54.234 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.226+0000 7fc834827700 1 -- start start 2023-09-29T23:09:54.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc834827700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc830067b60 0x7fc83013d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:54.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc834827700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc83009d320 0x7fc8300986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:54.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc834827700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc83013fb10 0x7fc83014ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:54.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc834827700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83014b700 con 0x7fc83009d320 2023-09-29T23:09:54.236 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc834827700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83014b9c0 con 0x7fc83013fb10 2023-09-29T23:09:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc834827700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83006f330 con 0x7fc830067b60 2023-09-29T23:09:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc82e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc83009d320 0x7fc8300986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc82ed9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc830067b60 0x7fc83013d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc82e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc83009d320 0x7fc8300986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45152/0 (socket says 172.21.15.115:45152) 2023-09-29T23:09:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc82e59c700 1 -- 172.21.15.115:0/716438255 learned_addr learned my addr 172.21.15.115:0/716438255 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc82f59e700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc83013fb10 0x7fc83014ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc82e59c700 1 -- 172.21.15.115:0/716438255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc830067b60 msgr2=0x7fc83013d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc82e59c700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc830067b60 0x7fc83013d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc82e59c700 1 -- 172.21.15.115:0/716438255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc83013fb10 msgr2=0x7fc83014ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc82e59c700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc83013fb10 0x7fc83014ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:54.237 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc82e59c700 1 -- 172.21.15.115:0/716438255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8280094f0 con 0x7fc83009d320 2023-09-29T23:09:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc82f59e700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc83013fb10 0x7fc83014ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:09:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc82e59c700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc83009d320 0x7fc8300986d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc820009ef0 tx=0x7fc82000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc816ffd700 1 -- 172.21.15.115:0/716438255 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82000cc20 con 0x7fc83009d320 2023-09-29T23:09:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc816ffd700 1 -- 172.21.15.115:0/716438255 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82000f040 con 0x7fc83009d320 2023-09-29T23:09:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc834827700 1 -- 172.21.15.115:0/716438255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc830098fb0 con 0x7fc83009d320 2023-09-29T23:09:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc816ffd700 1 -- 172.21.15.115:0/716438255 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820014480 con 0x7fc83009d320 2023-09-29T23:09:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc834827700 1 -- 172.21.15.115:0/716438255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83014b270 con 0x7fc83009d320 2023-09-29T23:09:54.238 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.230+0000 7fc834827700 1 -- 172.21.15.115:0/716438255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83014b4c0 con 0x7fc83009d320 2023-09-29T23:09:54.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.234+0000 7fc816ffd700 1 -- 172.21.15.115:0/716438255 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc8200147f0 con 0x7fc83009d320 2023-09-29T23:09:54.240 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.234+0000 7fc816ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.234+0000 7fc816ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.234+0000 7fc816ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.234+0000 7fc816ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.234+0000 7fc816ffd700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc81c08e8b0 0x7fc81c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:54.241 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.234+0000 7fc816ffd700 1 -- 172.21.15.115:0/716438255 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fc8200b5270 con 0x7fc83009d320 2023-09-29T23:09:54.242 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.234+0000 7fc82ed9d700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc81c08e8b0 0x7fc81c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:54.243 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.238+0000 7fc82ed9d700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc81c08e8b0 0x7fc81c090d60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc824007fd0 tx=0x7fc824007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:54.250 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.242+0000 7fc816ffd700 1 -- 172.21.15.115:0/716438255 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc83014b4c0 con 0x7fc83009d320 2023-09-29T23:09:54.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.434+0000 7fc834827700 1 -- 172.21.15.115:0/716438255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc83014b4c0 con 0x7fc83009d320 2023-09-29T23:09:54.442 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.434+0000 7fc816ffd700 1 -- 172.21.15.115:0/716438255 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fc83014b4c0 con 0x7fc83009d320 2023-09-29T23:09:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:54.442 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:54.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.438+0000 7fc834827700 10 mgrc shutdown 2023-09-29T23:09:54.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.438+0000 7fc834827700 1 -- 172.21.15.115:0/716438255 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc81c08e8b0 msgr2=0x7fc81c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:54.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.438+0000 7fc834827700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc81c08e8b0 0x7fc81c090d60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc824007fd0 tx=0x7fc824007d50 comp rx=0 tx=0).stop 2023-09-29T23:09:54.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.438+0000 7fc834827700 1 -- 172.21.15.115:0/716438255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc83009d320 msgr2=0x7fc8300986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:54.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.438+0000 7fc834827700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc83009d320 0x7fc8300986d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc820009ef0 tx=0x7fc82000b040 comp rx=0 tx=0).stop 2023-09-29T23:09:54.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.438+0000 7fc834827700 1 -- 172.21.15.115:0/716438255 shutdown_connections 2023-09-29T23:09:54.446 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.438+0000 7fc834827700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc83013fb10 0x7fc83014ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.438+0000 7fc834827700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fc81c08e8b0 0x7fc81c090d60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.438+0000 7fc834827700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc83009d320 0x7fc8300986d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.438+0000 7fc834827700 1 --2- 172.21.15.115:0/716438255 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc830067b60 0x7fc83013d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.438+0000 7fc834827700 1 -- 172.21.15.115:0/716438255 >> 172.21.15.115:0/716438255 conn(0x7fc8300b1d20 msgr2=0x7fc8300afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.438+0000 7fc834827700 1 -- 172.21.15.115:0/716438255 shutdown_connections 2023-09-29T23:09:54.447 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:54.438+0000 7fc834827700 1 -- 172.21.15.115:0/716438255 wait complete. 2023-09-29T23:09:57.463 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:09:57.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddfffff700 1 Processor -- start 2023-09-29T23:09:57.572 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddfffff700 1 -- start start 2023-09-29T23:09:57.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddfffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fde000a36a0 0x7fde0009c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:57.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddfffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fde000a0f50 0x7fde00147090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:57.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddfffff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0013fd50 con 0x7fde000a32d0 2023-09-29T23:09:57.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddfffff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0013fff0 con 0x7fde000a0f50 2023-09-29T23:09:57.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddfffff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde00140290 con 0x7fde000a36a0 2023-09-29T23:09:57.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddff7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fde000a0f50 0x7fde00147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:57.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddff7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fde000a0f50 0x7fde00147090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45166/0 (socket says 172.21.15.115:45166) 2023-09-29T23:09:57.574 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddff7fe700 1 -- 172.21.15.115:0/967837635 learned_addr learned my addr 172.21.15.115:0/967837635 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:57.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddfeffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fde000a32d0 0x7fde0009e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:45476/0 (socket says 172.21.15.115:45476) 2023-09-29T23:09:57.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddfe7fc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fde000a36a0 0x7fde0009c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:57.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddff7fe700 1 -- 172.21.15.115:0/967837635 >> v2:172.21.15.156:3300/0 conn(0x7fde000a36a0 msgr2=0x7fde0009c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:09:57.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddff7fe700 1 --2- 172.21.15.115:0/967837635 >> v2:172.21.15.156:3300/0 conn(0x7fde000a36a0 0x7fde0009c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:57.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddff7fe700 1 -- 172.21.15.115:0/967837635 >> v1:172.21.15.115:6789/0 conn(0x7fde000a32d0 legacy=0x7fde0009e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:57.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddff7fe700 1 -- 172.21.15.115:0/967837635 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0009dbf0 con 0x7fde000a0f50 2023-09-29T23:09:57.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddff7fe700 1 --2- 172.21.15.115:0/967837635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde000a0f50 0x7fde00147090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fde0009daf0 tx=0x7fddf8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be46f0bf4dca253 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:57.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddfdffb700 1 -- 172.21.15.115:0/967837635 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf800e070 con 0x7fde000a0f50 2023-09-29T23:09:57.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddfdffb700 1 -- 172.21.15.115:0/967837635 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf800b920 con 0x7fde000a0f50 2023-09-29T23:09:57.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.566+0000 7fddfdffb700 1 -- 172.21.15.115:0/967837635 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf80092e0 con 0x7fde000a0f50 2023-09-29T23:09:57.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 -- 172.21.15.115:0/967837635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde000a0f50 msgr2=0x7fde00147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:57.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 --2- 172.21.15.115:0/967837635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde000a0f50 0x7fde00147090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fde0009daf0 tx=0x7fddf8009840 comp rx=0 tx=0).stop 2023-09-29T23:09:57.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 -- 172.21.15.115:0/967837635 shutdown_connections 2023-09-29T23:09:57.576 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 --2- 172.21.15.115:0/967837635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde000a0f50 0x7fde00147090 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:57.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 --2- 172.21.15.115:0/967837635 >> v2:172.21.15.156:3300/0 conn(0x7fde000a36a0 0x7fde0009c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:57.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 -- 172.21.15.115:0/967837635 >> 172.21.15.115:0/967837635 conn(0x7fde000b1d20 msgr2=0x7fde000b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:57.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 -- 172.21.15.115:0/967837635 shutdown_connections 2023-09-29T23:09:57.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 -- 172.21.15.115:0/967837635 wait complete. 2023-09-29T23:09:57.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 Processor -- start 2023-09-29T23:09:57.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 -- start start 2023-09-29T23:09:57.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde000a0f50 0x7fde0013f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:57.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde000a32d0 0x7fde0014e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:57.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde000a36a0 0x7fde0014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:57.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0006f120 con 0x7fde000a0f50 2023-09-29T23:09:57.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0006f570 con 0x7fde000a36a0 2023-09-29T23:09:57.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0014edc0 con 0x7fde000a32d0 2023-09-29T23:09:57.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde000a0f50 0x7fde0013f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:57.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfe7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde000a32d0 0x7fde0014e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:57.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfeffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde000a0f50 0x7fde0013f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45168/0 (socket says 172.21.15.115:45168) 2023-09-29T23:09:57.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.570+0000 7fddfeffd700 1 -- 172.21.15.115:0/533923183 learned_addr learned my addr 172.21.15.115:0/533923183 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:09:57.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.574+0000 7fddff7fe700 1 --2- 172.21.15.115:0/533923183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde000a36a0 0x7fde0014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:57.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.574+0000 7fddfeffd700 1 -- 172.21.15.115:0/533923183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde000a32d0 msgr2=0x7fde0014e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:57.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.574+0000 7fddfeffd700 1 --2- 172.21.15.115:0/533923183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde000a32d0 0x7fde0014e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:57.580 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.574+0000 7fddfeffd700 1 -- 172.21.15.115:0/533923183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde000a36a0 msgr2=0x7fde0014a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:57.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.574+0000 7fddfeffd700 1 --2- 172.21.15.115:0/533923183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde000a36a0 0x7fde0014a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:57.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.574+0000 7fddfeffd700 1 -- 172.21.15.115:0/533923183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf8009ae0 con 0x7fde000a0f50 2023-09-29T23:09:57.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.574+0000 7fddfeffd700 1 --2- 172.21.15.115:0/533923183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde000a0f50 0x7fde0013f250 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fddf400c840 tx=0x7fddf4007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:57.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.574+0000 7fdde6ffd700 1 -- 172.21.15.115:0/533923183 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4005a70 con 0x7fde000a0f50 2023-09-29T23:09:57.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.574+0000 7fdde6ffd700 1 -- 172.21.15.115:0/533923183 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4005bf0 con 0x7fde000a0f50 2023-09-29T23:09:57.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.574+0000 7fddfffff700 1 -- 172.21.15.115:0/533923183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0014f080 con 0x7fde000a0f50 2023-09-29T23:09:57.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.574+0000 7fdde6ffd700 1 -- 172.21.15.115:0/533923183 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40070d0 con 0x7fde000a0f50 2023-09-29T23:09:57.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.574+0000 7fddfffff700 1 -- 172.21.15.115:0/533923183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0013f790 con 0x7fde000a0f50 2023-09-29T23:09:57.581 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.574+0000 7fddfffff700 1 -- 172.21.15.115:0/533923183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0004be00 con 0x7fde000a0f50 2023-09-29T23:09:57.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.578+0000 7fdde6ffd700 1 -- 172.21.15.115:0/533923183 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fddf4007440 con 0x7fde000a0f50 2023-09-29T23:09:57.584 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.578+0000 7fdde6ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:09:57.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.578+0000 7fdde6ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:09:57.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.578+0000 7fdde6ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:57.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.578+0000 7fdde6ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:09:57.585 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.578+0000 7fdde6ffd700 1 --2- 172.21.15.115:0/533923183 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fddec08e8b0 0x7fddec090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:09:57.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.578+0000 7fdde6ffd700 1 -- 172.21.15.115:0/533923183 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fddf40b4220 con 0x7fde000a0f50 2023-09-29T23:09:57.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.578+0000 7fddfe7fc700 1 --2- 172.21.15.115:0/533923183 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fddec08e8b0 0x7fddec090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:09:57.586 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.578+0000 7fddfe7fc700 1 --2- 172.21.15.115:0/533923183 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fddec08e8b0 0x7fddec090d60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fddf000bfd0 tx=0x7fddf000d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:09:57.588 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.582+0000 7fdde6ffd700 1 -- 172.21.15.115:0/533923183 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fddf4084bb0 con 0x7fde000a0f50 2023-09-29T23:09:57.782 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.774+0000 7fddfffff700 1 -- 172.21.15.115:0/533923183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fde00140530 con 0x7fde000a0f50 2023-09-29T23:09:57.783 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fdde6ffd700 1 -- 172.21.15.115:0/533923183 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fddf4017100 con 0x7fde000a0f50 2023-09-29T23:09:57.783 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:09:57.783 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:09:57.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fddfffff700 10 mgrc shutdown 2023-09-29T23:09:57.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fddfffff700 1 -- 172.21.15.115:0/533923183 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fddec08e8b0 msgr2=0x7fddec090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:57.785 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fddfffff700 1 --2- 172.21.15.115:0/533923183 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fddec08e8b0 0x7fddec090d60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fddf000bfd0 tx=0x7fddf000d040 comp rx=0 tx=0).stop 2023-09-29T23:09:57.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fddfffff700 1 -- 172.21.15.115:0/533923183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde000a0f50 msgr2=0x7fde0013f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:09:57.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fddfffff700 1 --2- 172.21.15.115:0/533923183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde000a0f50 0x7fde0013f250 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fddf400c840 tx=0x7fddf4007f30 comp rx=0 tx=0).stop 2023-09-29T23:09:57.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fddfffff700 1 -- 172.21.15.115:0/533923183 shutdown_connections 2023-09-29T23:09:57.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fddfffff700 1 --2- 172.21.15.115:0/533923183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde000a36a0 0x7fde0014a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:57.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fddfffff700 1 --2- 172.21.15.115:0/533923183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fde000a32d0 0x7fde0014e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:57.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fddfffff700 1 --2- 172.21.15.115:0/533923183 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fddec08e8b0 0x7fddec090d60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:57.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fddfffff700 1 --2- 172.21.15.115:0/533923183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde000a0f50 0x7fde0013f250 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:09:57.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fddfffff700 1 -- 172.21.15.115:0/533923183 >> 172.21.15.115:0/533923183 conn(0x7fde000b1d20 msgr2=0x7fde0013cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:09:57.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fddfffff700 1 -- 172.21.15.115:0/533923183 shutdown_connections 2023-09-29T23:09:57.786 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:09:57.778+0000 7fddfffff700 1 -- 172.21.15.115:0/533923183 wait complete. 2023-09-29T23:10:00.001 INFO:tasks.ceph.mon.a.smithi115.stderr:2023-09-29T23:09:59.998+0000 7f8e1c591700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-29T23:10:00.799 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:10:00.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.902+0000 7f8a39280700 1 Processor -- start 2023-09-29T23:10:00.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.902+0000 7f8a39280700 1 -- start start 2023-09-29T23:10:00.913 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a39280700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3409ddb0 0x7f8a34140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:00.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a39280700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3413e770 con 0x7f8a3409d9e0 2023-09-29T23:10:00.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a39280700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3413dc00 con 0x7f8a3413d700 2023-09-29T23:10:00.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a39280700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34141d20 con 0x7f8a3409ddb0 2023-09-29T23:10:00.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a337fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3409ddb0 0x7f8a34140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:00.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a33fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8a3409d9e0 0x7f8a34141610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:45480/0 (socket says 172.21.15.115:45480) 2023-09-29T23:10:00.914 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a33fff700 1 -- 172.21.15.115:0/4123619890 learned_addr learned my addr 172.21.15.115:0/4123619890 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:10:00.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a32ffd700 1 -- 172.21.15.115:0/4123619890 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570158524 0 0) 0x7f8a3413e770 con 0x7f8a3409d9e0 2023-09-29T23:10:00.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a32ffd700 1 -- 172.21.15.115:0/4123619890 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a1c003570 con 0x7f8a3409d9e0 2023-09-29T23:10:00.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a32ffd700 1 -- 172.21.15.115:0/4123619890 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937889452 0 0) 0x7f8a3413dc00 con 0x7f8a3413d700 2023-09-29T23:10:00.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a337fe700 1 -- 172.21.15.115:0/4123619890 >> v1:172.21.15.156:6789/0 conn(0x7f8a3413d700 legacy=0x7f8a340a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:00.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a337fe700 1 -- 172.21.15.115:0/4123619890 >> v1:172.21.15.115:6789/0 conn(0x7f8a3409d9e0 legacy=0x7f8a34141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:00.915 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a337fe700 1 -- 172.21.15.115:0/4123619890 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3413dec0 con 0x7f8a3409ddb0 2023-09-29T23:10:00.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a337fe700 1 --2- 172.21.15.115:0/4123619890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3409ddb0 0x7f8a34140d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009910 tx=0x7f8a240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0cca8065529bbc server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:00.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a32ffd700 1 -- 172.21.15.115:0/4123619890 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2400b710 con 0x7f8a3409ddb0 2023-09-29T23:10:00.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a32ffd700 1 -- 172.21.15.115:0/4123619890 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2400b870 con 0x7f8a3409ddb0 2023-09-29T23:10:00.916 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a32ffd700 1 -- 172.21.15.115:0/4123619890 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2400bbf0 con 0x7f8a3409ddb0 2023-09-29T23:10:00.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a39280700 1 -- 172.21.15.115:0/4123619890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3409ddb0 msgr2=0x7f8a34140d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:00.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a39280700 1 --2- 172.21.15.115:0/4123619890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3409ddb0 0x7f8a34140d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009910 tx=0x7f8a240091a0 comp rx=0 tx=0).stop 2023-09-29T23:10:00.920 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a39280700 1 -- 172.21.15.115:0/4123619890 shutdown_connections 2023-09-29T23:10:00.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a39280700 1 --2- 172.21.15.115:0/4123619890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3409ddb0 0x7f8a34140d50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:00.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a39280700 1 -- 172.21.15.115:0/4123619890 >> 172.21.15.115:0/4123619890 conn(0x7f8a340b1d20 msgr2=0x7f8a340b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:00.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a39280700 1 -- 172.21.15.115:0/4123619890 shutdown_connections 2023-09-29T23:10:00.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.906+0000 7f8a39280700 1 -- 172.21.15.115:0/4123619890 wait complete. 2023-09-29T23:10:00.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.910+0000 7f8a39280700 1 Processor -- start 2023-09-29T23:10:00.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.910+0000 7f8a39280700 1 -- start start 2023-09-29T23:10:00.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.910+0000 7f8a39280700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a3409d9e0 0x7f8a3406df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:00.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.910+0000 7f8a39280700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3409ddb0 0x7f8a34096c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:00.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.910+0000 7f8a39280700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a3413d700 0x7f8a340971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:00.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.910+0000 7f8a39280700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34097710 con 0x7f8a3409d9e0 2023-09-29T23:10:00.921 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.910+0000 7f8a39280700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34151050 con 0x7f8a3413d700 2023-09-29T23:10:00.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.910+0000 7f8a39280700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34151310 con 0x7f8a3409ddb0 2023-09-29T23:10:00.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.910+0000 7f8a33fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a3409d9e0 0x7f8a3406df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:00.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.910+0000 7f8a33fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a3409d9e0 0x7f8a3406df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45176/0 (socket says 172.21.15.115:45176) 2023-09-29T23:10:00.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.910+0000 7f8a33fff700 1 -- 172.21.15.115:0/1225947275 learned_addr learned my addr 172.21.15.115:0/1225947275 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:10:00.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.910+0000 7f8a337fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3409ddb0 0x7f8a34096c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:00.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.910+0000 7f8a38a7f700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a3413d700 0x7f8a340971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:00.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.914+0000 7f8a33fff700 1 -- 172.21.15.115:0/1225947275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3409ddb0 msgr2=0x7f8a34096c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:00.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.914+0000 7f8a33fff700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3409ddb0 0x7f8a34096c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:00.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.914+0000 7f8a33fff700 1 -- 172.21.15.115:0/1225947275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a3413d700 msgr2=0x7f8a340971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:00.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.914+0000 7f8a33fff700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a3413d700 0x7f8a340971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:00.922 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.914+0000 7f8a33fff700 1 -- 172.21.15.115:0/1225947275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24009420 con 0x7f8a3409d9e0 2023-09-29T23:10:00.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.914+0000 7f8a38a7f700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a3413d700 0x7f8a340971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:10:00.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.914+0000 7f8a33fff700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a3409d9e0 0x7f8a3406df90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8a280011e0 tx=0x7f8a28007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:00.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.914+0000 7f8a1bfff700 1 -- 172.21.15.115:0/1225947275 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a28005b30 con 0x7f8a3409d9e0 2023-09-29T23:10:00.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.914+0000 7f8a1bfff700 1 -- 172.21.15.115:0/1225947275 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a28005c90 con 0x7f8a3409d9e0 2023-09-29T23:10:00.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.914+0000 7f8a39280700 1 -- 172.21.15.115:0/1225947275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a341515d0 con 0x7f8a3409d9e0 2023-09-29T23:10:00.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.914+0000 7f8a1bfff700 1 -- 172.21.15.115:0/1225947275 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a28007320 con 0x7f8a3409d9e0 2023-09-29T23:10:00.923 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.914+0000 7f8a39280700 1 -- 172.21.15.115:0/1225947275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3406e900 con 0x7f8a3409d9e0 2023-09-29T23:10:00.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.914+0000 7f8a39280700 1 -- 172.21.15.115:0/1225947275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3404be00 con 0x7f8a3409d9e0 2023-09-29T23:10:00.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.918+0000 7f8a1bfff700 1 -- 172.21.15.115:0/1225947275 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f8a28007690 con 0x7f8a3409d9e0 2023-09-29T23:10:00.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.918+0000 7f8a1bfff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:10:00.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.918+0000 7f8a1bfff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:10:00.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.918+0000 7f8a1bfff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:00.924 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.918+0000 7f8a1bfff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:00.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.918+0000 7f8a1bfff700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8a2008e8b0 0x7f8a20090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:00.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.918+0000 7f8a1bfff700 1 -- 172.21.15.115:0/1225947275 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f8a280b3da0 con 0x7f8a3409d9e0 2023-09-29T23:10:00.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.918+0000 7f8a337fe700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8a2008e8b0 0x7f8a20090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:00.925 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.918+0000 7f8a337fe700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8a2008e8b0 0x7f8a20090d60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009910 tx=0x7f8a24017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:00.930 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:00.922+0000 7f8a1bfff700 1 -- 172.21.15.115:0/1225947275 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8a28084730 con 0x7f8a3409d9e0 2023-09-29T23:10:01.129 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.122+0000 7f8a39280700 1 -- 172.21.15.115:0/1225947275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8a340a3e70 con 0x7f8a3409d9e0 2023-09-29T23:10:01.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.122+0000 7f8a1bfff700 1 -- 172.21.15.115:0/1225947275 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f8a28017080 con 0x7f8a3409d9e0 2023-09-29T23:10:01.130 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:10:01.130 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:10:01.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.126+0000 7f8a39280700 10 mgrc shutdown 2023-09-29T23:10:01.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.126+0000 7f8a39280700 1 -- 172.21.15.115:0/1225947275 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8a2008e8b0 msgr2=0x7f8a20090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:01.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.126+0000 7f8a39280700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8a2008e8b0 0x7f8a20090d60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009910 tx=0x7f8a24017000 comp rx=0 tx=0).stop 2023-09-29T23:10:01.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.126+0000 7f8a39280700 1 -- 172.21.15.115:0/1225947275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a3409d9e0 msgr2=0x7f8a3406df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:01.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.126+0000 7f8a39280700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a3409d9e0 0x7f8a3406df90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8a280011e0 tx=0x7f8a28007df0 comp rx=0 tx=0).stop 2023-09-29T23:10:01.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.126+0000 7f8a39280700 1 -- 172.21.15.115:0/1225947275 shutdown_connections 2023-09-29T23:10:01.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.126+0000 7f8a39280700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a3413d700 0x7f8a340971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:01.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.126+0000 7f8a39280700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3409ddb0 0x7f8a34096c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:01.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.126+0000 7f8a39280700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f8a2008e8b0 0x7f8a20090d60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:01.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.126+0000 7f8a39280700 1 --2- 172.21.15.115:0/1225947275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a3409d9e0 0x7f8a3406df90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:01.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.126+0000 7f8a39280700 1 -- 172.21.15.115:0/1225947275 >> 172.21.15.115:0/1225947275 conn(0x7f8a340b1d20 msgr2=0x7f8a34069370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:01.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.126+0000 7f8a39280700 1 -- 172.21.15.115:0/1225947275 shutdown_connections 2023-09-29T23:10:01.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:01.126+0000 7f8a39280700 1 -- 172.21.15.115:0/1225947275 wait complete. 2023-09-29T23:10:04.149 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:10:04.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8af59e700 1 Processor -- start 2023-09-29T23:10:04.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8af59e700 1 -- start start 2023-09-29T23:10:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8af59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff8b00670a0 0x7ff8b0067a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8af59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff8b0067f60 0x7ff8b014e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8af59e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b00a3710 con 0x7ff8b00a4140 2023-09-29T23:10:04.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8af59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b009bd40 con 0x7ff8b0067f60 2023-09-29T23:10:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8af59e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b00a4510 con 0x7ff8b00670a0 2023-09-29T23:10:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8ae59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff8b00a4140 0x7ff8b009d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51982/0 (socket says 172.21.15.115:51982) 2023-09-29T23:10:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8ae59c700 1 -- 172.21.15.115:0/3410641666 learned_addr learned my addr 172.21.15.115:0/3410641666 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:10:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8aed9d700 1 --2- 172.21.15.115:0/3410641666 >> v2:172.21.15.115:3300/0 conn(0x7ff8b0067f60 0x7ff8b014e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8a5d9b700 1 --2- 172.21.15.115:0/3410641666 >> v2:172.21.15.156:3300/0 conn(0x7ff8b00670a0 0x7ff8b0067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8add9b700 1 -- 172.21.15.115:0/3410641666 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979962682 0 0) 0x7ff8b00a3710 con 0x7ff8b00a4140 2023-09-29T23:10:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8add9b700 1 -- 172.21.15.115:0/3410641666 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff89c003570 con 0x7ff8b00a4140 2023-09-29T23:10:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8aed9d700 1 -- 172.21.15.115:0/3410641666 >> v2:172.21.15.156:3300/0 conn(0x7ff8b00670a0 msgr2=0x7ff8b0067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:10:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8aed9d700 1 --2- 172.21.15.115:0/3410641666 >> v2:172.21.15.156:3300/0 conn(0x7ff8b00670a0 0x7ff8b0067a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:04.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8aed9d700 1 -- 172.21.15.115:0/3410641666 >> v1:172.21.15.115:6789/0 conn(0x7ff8b00a4140 legacy=0x7ff8b009d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:04.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8add9b700 1 -- 172.21.15.115:0/3410641666 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1788876290 0 0) 0x7ff89c003570 con 0x7ff8b00a4140 2023-09-29T23:10:04.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8aed9d700 1 -- 172.21.15.115:0/3410641666 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b00686b0 con 0x7ff8b0067f60 2023-09-29T23:10:04.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8aed9d700 1 --2- 172.21.15.115:0/3410641666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b0067f60 0x7ff8b014e7c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff8b006a3b0 tx=0x7ff8a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1071c0aaf67984f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:04.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8add9b700 1 -- 172.21.15.115:0/3410641666 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800e070 con 0x7ff8b0067f60 2023-09-29T23:10:04.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8add9b700 1 -- 172.21.15.115:0/3410641666 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a800b7a0 con 0x7ff8b0067f60 2023-09-29T23:10:04.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8add9b700 1 -- 172.21.15.115:0/3410641666 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0001470 con 0x7ff8b0067f60 2023-09-29T23:10:04.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8af59e700 1 -- 172.21.15.115:0/3410641666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b0067f60 msgr2=0x7ff8b014e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:04.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8af59e700 1 --2- 172.21.15.115:0/3410641666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b0067f60 0x7ff8b014e7c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff8b006a3b0 tx=0x7ff8a8009780 comp rx=0 tx=0).stop 2023-09-29T23:10:04.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8af59e700 1 -- 172.21.15.115:0/3410641666 shutdown_connections 2023-09-29T23:10:04.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8af59e700 1 --2- 172.21.15.115:0/3410641666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b0067f60 0x7ff8b014e7c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:04.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8af59e700 1 --2- 172.21.15.115:0/3410641666 >> v2:172.21.15.156:3300/0 conn(0x7ff8b00670a0 0x7ff8b0067a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:04.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.258+0000 7ff8af59e700 1 -- 172.21.15.115:0/3410641666 >> 172.21.15.115:0/3410641666 conn(0x7ff8b00b1d20 msgr2=0x7ff8b00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:04.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8af59e700 1 -- 172.21.15.115:0/3410641666 shutdown_connections 2023-09-29T23:10:04.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8af59e700 1 -- 172.21.15.115:0/3410641666 wait complete. 2023-09-29T23:10:04.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8af59e700 1 Processor -- start 2023-09-29T23:10:04.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8af59e700 1 -- start start 2023-09-29T23:10:04.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8af59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b00670a0 0x7ff8b006c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:04.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8af59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8b0067f60 0x7ff8b0096da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:04.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8af59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b00a4140 0x7ff8b00954d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:04.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8af59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b006e9d0 con 0x7ff8b00a4140 2023-09-29T23:10:04.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8af59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b006cbd0 con 0x7ff8b00670a0 2023-09-29T23:10:04.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8af59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b006ce90 con 0x7ff8b0067f60 2023-09-29T23:10:04.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8aed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b00a4140 0x7ff8b00954d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:04.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8a5d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8b0067f60 0x7ff8b0096da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:04.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8a5d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8b0067f60 0x7ff8b0096da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:47226/0 (socket says 172.21.15.115:47226) 2023-09-29T23:10:04.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8a5d9b700 1 -- 172.21.15.115:0/3999626097 learned_addr learned my addr 172.21.15.115:0/3999626097 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:10:04.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.262+0000 7ff8ae59c700 1 --2- 172.21.15.115:0/3999626097 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b00670a0 0x7ff8b006c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:04.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8a5d9b700 1 -- 172.21.15.115:0/3999626097 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b00670a0 msgr2=0x7ff8b006c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:04.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8a5d9b700 1 --2- 172.21.15.115:0/3999626097 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b00670a0 0x7ff8b006c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:04.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8a5d9b700 1 -- 172.21.15.115:0/3999626097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b00a4140 msgr2=0x7ff8b00954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:04.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8a5d9b700 1 --2- 172.21.15.115:0/3999626097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b00a4140 0x7ff8b00954d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:04.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8a5d9b700 1 -- 172.21.15.115:0/3999626097 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a8009a20 con 0x7ff8b0067f60 2023-09-29T23:10:04.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8a5d9b700 1 --2- 172.21.15.115:0/3999626097 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8b0067f60 0x7ff8b0096da0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff89800ec80 tx=0x7ff8980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:04.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8a6ffd700 1 -- 172.21.15.115:0/3999626097 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89800c850 con 0x7ff8b0067f60 2023-09-29T23:10:04.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8a6ffd700 1 -- 172.21.15.115:0/3999626097 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89800c9b0 con 0x7ff8b0067f60 2023-09-29T23:10:04.273 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8af59e700 1 -- 172.21.15.115:0/3999626097 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b0096030 con 0x7ff8b0067f60 2023-09-29T23:10:04.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8a6ffd700 1 -- 172.21.15.115:0/3999626097 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89800cd50 con 0x7ff8b0067f60 2023-09-29T23:10:04.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8af59e700 1 -- 172.21.15.115:0/3999626097 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b0095c70 con 0x7ff8b0067f60 2023-09-29T23:10:04.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8af59e700 1 -- 172.21.15.115:0/3999626097 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b004be00 con 0x7ff8b0067f60 2023-09-29T23:10:04.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8a6ffd700 1 -- 172.21.15.115:0/3999626097 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7ff898013680 con 0x7ff8b0067f60 2023-09-29T23:10:04.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.266+0000 7ff8a6ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:10:04.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.270+0000 7ff8a6ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:10:04.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.270+0000 7ff8a6ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:04.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.270+0000 7ff8a6ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:04.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.270+0000 7ff8a6ffd700 1 --2- 172.21.15.115:0/3999626097 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff89008e8b0 0x7ff890090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:04.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.270+0000 7ff8a6ffd700 1 -- 172.21.15.115:0/3999626097 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7ff8980b4ad0 con 0x7ff8b0067f60 2023-09-29T23:10:04.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.270+0000 7ff8ae59c700 1 --2- 172.21.15.115:0/3999626097 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff89008e8b0 0x7ff890090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:04.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.270+0000 7ff8ae59c700 1 --2- 172.21.15.115:0/3999626097 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff89008e8b0 0x7ff890090d60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0001620 tx=0x7ff8a00014c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:04.282 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.278+0000 7ff8a6ffd700 1 -- 172.21.15.115:0/3999626097 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff898085500 con 0x7ff8b0067f60 2023-09-29T23:10:04.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.470+0000 7ff8af59e700 1 -- 172.21.15.115:0/3999626097 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff8b00b2610 con 0x7ff8b0067f60 2023-09-29T23:10:04.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.470+0000 7ff8a6ffd700 1 -- 172.21.15.115:0/3999626097 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff898017100 con 0x7ff8b0067f60 2023-09-29T23:10:04.477 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:10:04.477 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:10:04.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.474+0000 7ff8af59e700 10 mgrc shutdown 2023-09-29T23:10:04.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.474+0000 7ff8af59e700 1 -- 172.21.15.115:0/3999626097 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff89008e8b0 msgr2=0x7ff890090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:04.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.474+0000 7ff8af59e700 1 --2- 172.21.15.115:0/3999626097 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff89008e8b0 0x7ff890090d60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0001620 tx=0x7ff8a00014c0 comp rx=0 tx=0).stop 2023-09-29T23:10:04.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.474+0000 7ff8af59e700 1 -- 172.21.15.115:0/3999626097 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8b0067f60 msgr2=0x7ff8b0096da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:04.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.474+0000 7ff8af59e700 1 --2- 172.21.15.115:0/3999626097 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8b0067f60 0x7ff8b0096da0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff89800ec80 tx=0x7ff8980091a0 comp rx=0 tx=0).stop 2023-09-29T23:10:04.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.474+0000 7ff8af59e700 1 -- 172.21.15.115:0/3999626097 shutdown_connections 2023-09-29T23:10:04.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.474+0000 7ff8af59e700 1 --2- 172.21.15.115:0/3999626097 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7ff89008e8b0 0x7ff890090d60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:04.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.474+0000 7ff8af59e700 1 --2- 172.21.15.115:0/3999626097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8b00a4140 0x7ff8b00954d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:04.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.474+0000 7ff8af59e700 1 --2- 172.21.15.115:0/3999626097 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8b0067f60 0x7ff8b0096da0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:04.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.474+0000 7ff8af59e700 1 --2- 172.21.15.115:0/3999626097 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8b00670a0 0x7ff8b006c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:04.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.474+0000 7ff8af59e700 1 -- 172.21.15.115:0/3999626097 >> 172.21.15.115:0/3999626097 conn(0x7ff8b00b1d20 msgr2=0x7ff8b0069260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:04.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.474+0000 7ff8af59e700 1 -- 172.21.15.115:0/3999626097 shutdown_connections 2023-09-29T23:10:04.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:04.474+0000 7ff8af59e700 1 -- 172.21.15.115:0/3999626097 wait complete. 2023-09-29T23:10:07.496 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:10:07.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e493f7700 1 Processor -- start 2023-09-29T23:10:07.608 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e493f7700 1 -- start start 2023-09-29T23:10:07.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e493f7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6e4409c190 0x7f6e440a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:07.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e493f7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e440a5d60 0x7f6e4406a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:07.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e493f7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6e4413fbd0 0x7f6e4406d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:07.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e493f7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4409c560 con 0x7f6e4413fbd0 2023-09-29T23:10:07.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e493f7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e440a5900 con 0x7f6e4409c190 2023-09-29T23:10:07.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e493f7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e44140180 con 0x7f6e440a5d60 2023-09-29T23:10:07.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e437fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e440a5d60 0x7f6e4406a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:07.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e437fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e440a5d60 0x7f6e4406a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:47228/0 (socket says 172.21.15.115:47228) 2023-09-29T23:10:07.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e437fe700 1 -- 172.21.15.115:0/1869996299 learned_addr learned my addr 172.21.15.115:0/1869996299 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:10:07.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e48bf6700 1 --2- 172.21.15.115:0/1869996299 >> v2:172.21.15.115:3300/0 conn(0x7f6e4413fbd0 0x7f6e4406d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:07.609 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e43fff700 1 --2- 172.21.15.115:0/1869996299 >> v2:172.21.15.156:3300/0 conn(0x7f6e4409c190 0x7f6e440a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:07.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e437fe700 1 -- 172.21.15.115:0/1869996299 >> v2:172.21.15.156:3300/0 conn(0x7f6e4409c190 msgr2=0x7f6e440a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:10:07.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e437fe700 1 --2- 172.21.15.115:0/1869996299 >> v2:172.21.15.156:3300/0 conn(0x7f6e4409c190 0x7f6e440a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:07.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e437fe700 1 -- 172.21.15.115:0/1869996299 >> v2:172.21.15.115:3300/0 conn(0x7f6e4413fbd0 msgr2=0x7f6e4406d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:10:07.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e437fe700 1 --2- 172.21.15.115:0/1869996299 >> v2:172.21.15.115:3300/0 conn(0x7f6e4413fbd0 0x7f6e4406d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:07.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e437fe700 1 -- 172.21.15.115:0/1869996299 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44140420 con 0x7f6e440a5d60 2023-09-29T23:10:07.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e43fff700 1 --2- 172.21.15.115:0/1869996299 >> v2:172.21.15.156:3300/0 conn(0x7f6e4409c190 0x7f6e440a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-29T23:10:07.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e437fe700 1 --2- 172.21.15.115:0/1869996299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e440a5d60 0x7f6e4406a310 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6e4406add0 tx=0x7f6e2c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a16169c57f4fb26 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:07.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.598+0000 7f6e42ffd700 1 -- 172.21.15.115:0/1869996299 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c00e070 con 0x7f6e440a5d60 2023-09-29T23:10:07.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.602+0000 7f6e42ffd700 1 -- 172.21.15.115:0/1869996299 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c00ba20 con 0x7f6e440a5d60 2023-09-29T23:10:07.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.602+0000 7f6e42ffd700 1 -- 172.21.15.115:0/1869996299 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c0092e0 con 0x7f6e440a5d60 2023-09-29T23:10:07.610 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.602+0000 7f6e493f7700 1 -- 172.21.15.115:0/1869996299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e440a5d60 msgr2=0x7f6e4406a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:07.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.602+0000 7f6e493f7700 1 --2- 172.21.15.115:0/1869996299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e440a5d60 0x7f6e4406a310 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6e4406add0 tx=0x7f6e2c009840 comp rx=0 tx=0).stop 2023-09-29T23:10:07.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.602+0000 7f6e493f7700 1 -- 172.21.15.115:0/1869996299 shutdown_connections 2023-09-29T23:10:07.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.602+0000 7f6e493f7700 1 --2- 172.21.15.115:0/1869996299 >> v2:172.21.15.115:3300/0 conn(0x7f6e4413fbd0 0x7f6e4406d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:07.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.602+0000 7f6e493f7700 1 --2- 172.21.15.115:0/1869996299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e440a5d60 0x7f6e4406a310 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:07.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.602+0000 7f6e493f7700 1 --2- 172.21.15.115:0/1869996299 >> v2:172.21.15.156:3300/0 conn(0x7f6e4409c190 0x7f6e440a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:07.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.602+0000 7f6e493f7700 1 -- 172.21.15.115:0/1869996299 >> 172.21.15.115:0/1869996299 conn(0x7f6e44068a40 msgr2=0x7f6e44068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:07.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.602+0000 7f6e493f7700 1 -- 172.21.15.115:0/1869996299 shutdown_connections 2023-09-29T23:10:07.611 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.602+0000 7f6e493f7700 1 -- 172.21.15.115:0/1869996299 wait complete. 2023-09-29T23:10:07.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.602+0000 7f6e493f7700 1 Processor -- start 2023-09-29T23:10:07.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.602+0000 7f6e493f7700 1 -- start start 2023-09-29T23:10:07.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e493f7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e4409c190 0x7f6e441387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:07.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e493f7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e440a5d60 0x7f6e441504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:07.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e493f7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e4413fbd0 0x7f6e4409e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:07.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e493f7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e44150ba0 con 0x7f6e440a5d60 2023-09-29T23:10:07.615 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e493f7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e44150e60 con 0x7f6e4413fbd0 2023-09-29T23:10:07.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e493f7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e44151120 con 0x7f6e4409c190 2023-09-29T23:10:07.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e43fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e4409c190 0x7f6e441387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:07.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e437fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e440a5d60 0x7f6e441504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:07.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e43fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e4409c190 0x7f6e441387f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:47240/0 (socket says 172.21.15.115:47240) 2023-09-29T23:10:07.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e43fff700 1 -- 172.21.15.115:0/987499143 learned_addr learned my addr 172.21.15.115:0/987499143 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:10:07.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e48bf6700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e4413fbd0 0x7f6e4409e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:07.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e43fff700 1 -- 172.21.15.115:0/987499143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e4413fbd0 msgr2=0x7f6e4409e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:07.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e43fff700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e4413fbd0 0x7f6e4409e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:07.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e43fff700 1 -- 172.21.15.115:0/987499143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e440a5d60 msgr2=0x7f6e441504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:07.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e43fff700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e440a5d60 0x7f6e441504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:07.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e43fff700 1 -- 172.21.15.115:0/987499143 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c009ae0 con 0x7f6e4409c190 2023-09-29T23:10:07.616 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e437fe700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e440a5d60 0x7f6e441504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:10:07.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e43fff700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e4409c190 0x7f6e441387f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400c830 tx=0x7f6e34008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:07.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e3bfff700 1 -- 172.21.15.115:0/987499143 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34011600 con 0x7f6e4409c190 2023-09-29T23:10:07.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e3bfff700 1 -- 172.21.15.115:0/987499143 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e34011760 con 0x7f6e4409c190 2023-09-29T23:10:07.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e493f7700 1 -- 172.21.15.115:0/987499143 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4409ee70 con 0x7f6e4409c190 2023-09-29T23:10:07.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e3bfff700 1 -- 172.21.15.115:0/987499143 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34011b20 con 0x7f6e4409c190 2023-09-29T23:10:07.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.606+0000 7f6e493f7700 1 -- 172.21.15.115:0/987499143 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e44139060 con 0x7f6e4409c190 2023-09-29T23:10:07.617 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.610+0000 7f6e493f7700 1 -- 172.21.15.115:0/987499143 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4404be00 con 0x7f6e4409c190 2023-09-29T23:10:07.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.610+0000 7f6e3bfff700 1 -- 172.21.15.115:0/987499143 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f6e34024480 con 0x7f6e4409c190 2023-09-29T23:10:07.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.610+0000 7f6e3bfff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:10:07.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.610+0000 7f6e3bfff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:10:07.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.610+0000 7f6e3bfff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:07.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.610+0000 7f6e3bfff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:07.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.610+0000 7f6e3bfff700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6e2408e8b0 0x7f6e24090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:07.618 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.610+0000 7f6e3bfff700 1 -- 172.21.15.115:0/987499143 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f6e340b4bb0 con 0x7f6e4409c190 2023-09-29T23:10:07.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.610+0000 7f6e437fe700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6e2408e8b0 0x7f6e24090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:07.619 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.614+0000 7f6e437fe700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6e2408e8b0 0x7f6e24090d60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009880 tx=0x7f6e2c018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:07.623 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.618+0000 7f6e3bfff700 1 -- 172.21.15.115:0/987499143 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6e340855e0 con 0x7f6e4409c190 2023-09-29T23:10:07.817 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.810+0000 7f6e493f7700 1 -- 172.21.15.115:0/987499143 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6e4406ef20 con 0x7f6e4409c190 2023-09-29T23:10:07.818 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.810+0000 7f6e3bfff700 1 -- 172.21.15.115:0/987499143 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f6e34015100 con 0x7f6e4409c190 2023-09-29T23:10:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:10:07.818 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:10:07.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.814+0000 7f6e493f7700 10 mgrc shutdown 2023-09-29T23:10:07.820 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.814+0000 7f6e493f7700 1 -- 172.21.15.115:0/987499143 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6e2408e8b0 msgr2=0x7f6e24090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:07.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.814+0000 7f6e493f7700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6e2408e8b0 0x7f6e24090d60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009880 tx=0x7f6e2c018000 comp rx=0 tx=0).stop 2023-09-29T23:10:07.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.814+0000 7f6e493f7700 1 -- 172.21.15.115:0/987499143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e4409c190 msgr2=0x7f6e441387f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:07.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.814+0000 7f6e493f7700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e4409c190 0x7f6e441387f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400c830 tx=0x7f6e34008040 comp rx=0 tx=0).stop 2023-09-29T23:10:07.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.814+0000 7f6e493f7700 1 -- 172.21.15.115:0/987499143 shutdown_connections 2023-09-29T23:10:07.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.814+0000 7f6e493f7700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e4413fbd0 0x7f6e4409e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:07.821 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.814+0000 7f6e493f7700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f6e2408e8b0 0x7f6e24090d60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:07.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.814+0000 7f6e493f7700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e440a5d60 0x7f6e441504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:07.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.814+0000 7f6e493f7700 1 --2- 172.21.15.115:0/987499143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e4409c190 0x7f6e441387f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:07.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.814+0000 7f6e493f7700 1 -- 172.21.15.115:0/987499143 >> 172.21.15.115:0/987499143 conn(0x7f6e44068a40 msgr2=0x7f6e44068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:07.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.814+0000 7f6e493f7700 1 -- 172.21.15.115:0/987499143 shutdown_connections 2023-09-29T23:10:07.822 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:07.814+0000 7f6e493f7700 1 -- 172.21.15.115:0/987499143 wait complete. 2023-09-29T23:10:09.343 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:10:09.345 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:10:10.832 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:10:10.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccd66e700 1 Processor -- start 2023-09-29T23:10:10.947 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccd66e700 1 -- start start 2023-09-29T23:10:10.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccd66e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cc813d700 0x7f2cc8140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:10.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccd66e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc813e770 con 0x7f2cc809ddb0 2023-09-29T23:10:10.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccd66e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc813dc00 con 0x7f2cc809d9e0 2023-09-29T23:10:10.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccd66e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8141d20 con 0x7f2cc813d700 2023-09-29T23:10:10.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2cc77fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2cc809ddb0 0x7f2cc80a3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:51996/0 (socket says 172.21.15.115:51996) 2023-09-29T23:10:10.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccce6d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cc813d700 0x7f2cc8140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:10.948 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2cc77fe700 1 -- 172.21.15.115:0/2838786729 learned_addr learned my addr 172.21.15.115:0/2838786729 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:10:10.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2cc6ffd700 1 -- 172.21.15.115:0/2838786729 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164326707 0 0) 0x7f2cc813e770 con 0x7f2cc809ddb0 2023-09-29T23:10:10.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccce6d700 1 -- 172.21.15.115:0/2838786729 >> v1:172.21.15.156:6789/0 conn(0x7f2cc809d9e0 legacy=0x7f2cc8141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:10.949 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccce6d700 1 -- 172.21.15.115:0/2838786729 >> v1:172.21.15.115:6789/0 conn(0x7f2cc809ddb0 legacy=0x7f2cc80a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:10.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccce6d700 1 -- 172.21.15.115:0/2838786729 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc813dec0 con 0x7f2cc813d700 2023-09-29T23:10:10.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccce6d700 1 --2- 172.21.15.115:0/2838786729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cc813d700 0x7f2cc8140d50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009890 tx=0x7f2cb80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cbcde1ef44377af server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:10.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2cc6ffd700 1 -- 172.21.15.115:0/2838786729 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8011630 con 0x7f2cc813d700 2023-09-29T23:10:10.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2cc6ffd700 1 -- 172.21.15.115:0/2838786729 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb8011790 con 0x7f2cc813d700 2023-09-29T23:10:10.950 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2cc6ffd700 1 -- 172.21.15.115:0/2838786729 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8011b50 con 0x7f2cc813d700 2023-09-29T23:10:10.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccd66e700 1 -- 172.21.15.115:0/2838786729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cc813d700 msgr2=0x7f2cc8140d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:10.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccd66e700 1 --2- 172.21.15.115:0/2838786729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cc813d700 0x7f2cc8140d50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009890 tx=0x7f2cb80091a0 comp rx=0 tx=0).stop 2023-09-29T23:10:10.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccd66e700 1 -- 172.21.15.115:0/2838786729 shutdown_connections 2023-09-29T23:10:10.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccd66e700 1 --2- 172.21.15.115:0/2838786729 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cc813d700 0x7f2cc8140d50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:10.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccd66e700 1 -- 172.21.15.115:0/2838786729 >> 172.21.15.115:0/2838786729 conn(0x7f2cc80b1d20 msgr2=0x7f2cc80b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:10.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccd66e700 1 -- 172.21.15.115:0/2838786729 shutdown_connections 2023-09-29T23:10:10.951 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.942+0000 7f2ccd66e700 1 -- 172.21.15.115:0/2838786729 wait complete. 2023-09-29T23:10:10.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.946+0000 7f2ccd66e700 1 Processor -- start 2023-09-29T23:10:10.953 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.946+0000 7f2ccd66e700 1 -- start start 2023-09-29T23:10:10.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.946+0000 7f2ccd66e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc809d9e0 0x7f2cc813bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:10.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.946+0000 7f2ccd66e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cc809ddb0 0x7f2cc806e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:10.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.946+0000 7f2ccd66e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc813d700 0x7f2cc8098680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:10.955 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2ccd66e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc813c440 con 0x7f2cc809d9e0 2023-09-29T23:10:10.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2ccd66e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc814d480 con 0x7f2cc813d700 2023-09-29T23:10:10.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2ccd66e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8150cf0 con 0x7f2cc809ddb0 2023-09-29T23:10:10.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2cc77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cc809ddb0 0x7f2cc806e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:10.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2cc77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cc809ddb0 0x7f2cc806e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:47264/0 (socket says 172.21.15.115:47264) 2023-09-29T23:10:10.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2cc77fe700 1 -- 172.21.15.115:0/3693225679 learned_addr learned my addr 172.21.15.115:0/3693225679 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:10:10.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2cc7fff700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc809d9e0 0x7f2cc813bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:10.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2ccce6d700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc813d700 0x7f2cc8098680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:10.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2cc77fe700 1 -- 172.21.15.115:0/3693225679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc813d700 msgr2=0x7f2cc8098680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:10.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2cc77fe700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc813d700 0x7f2cc8098680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:10.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2cc77fe700 1 -- 172.21.15.115:0/3693225679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc809d9e0 msgr2=0x7f2cc813bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:10.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2cc77fe700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc809d9e0 0x7f2cc813bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:10.956 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2cc77fe700 1 -- 172.21.15.115:0/3693225679 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb8009420 con 0x7f2cc809ddb0 2023-09-29T23:10:10.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2cc7fff700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc809d9e0 0x7f2cc813bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:10:10.958 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2cc77fe700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cc809ddb0 0x7f2cc806e6b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00c7e0 tx=0x7f2cbc007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:10.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2caffff700 1 -- 172.21.15.115:0/3693225679 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc005b30 con 0x7f2cc809ddb0 2023-09-29T23:10:10.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2caffff700 1 -- 172.21.15.115:0/3693225679 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc005c90 con 0x7f2cc809ddb0 2023-09-29T23:10:10.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2ccd66e700 1 -- 172.21.15.115:0/3693225679 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc80977f0 con 0x7f2cc809ddb0 2023-09-29T23:10:10.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2caffff700 1 -- 172.21.15.115:0/3693225679 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc007300 con 0x7f2cc809ddb0 2023-09-29T23:10:10.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2ccd66e700 1 -- 172.21.15.115:0/3693225679 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc80b2710 con 0x7f2cc809ddb0 2023-09-29T23:10:10.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.950+0000 7f2ccd66e700 1 -- 172.21.15.115:0/3693225679 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc804be00 con 0x7f2cc809ddb0 2023-09-29T23:10:10.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.954+0000 7f2caffff700 1 -- 172.21.15.115:0/3693225679 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f2cbc025430 con 0x7f2cc809ddb0 2023-09-29T23:10:10.961 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.954+0000 7f2caffff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:10:10.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.954+0000 7f2caffff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:10:10.962 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.954+0000 7f2caffff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:10.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.954+0000 7f2caffff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:10.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.954+0000 7f2caffff700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2cb408e8b0 0x7f2cb4090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:10.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.958+0000 7f2cc7fff700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2cb408e8b0 0x7f2cb4090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:10.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.958+0000 7f2caffff700 1 -- 172.21.15.115:0/3693225679 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f2cbc0b4e10 con 0x7f2cc809ddb0 2023-09-29T23:10:10.964 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.958+0000 7f2cc7fff700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2cb408e8b0 0x7f2cb4090d60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0007fd0 tx=0x7f2cc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:10.969 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:10.962+0000 7f2caffff700 1 -- 172.21.15.115:0/3693225679 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2cbc085840 con 0x7f2cc809ddb0 2023-09-29T23:10:11.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.158+0000 7f2ccd66e700 1 -- 172.21.15.115:0/3693225679 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2cc80afff0 con 0x7f2cc809ddb0 2023-09-29T23:10:11.167 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.158+0000 7f2caffff700 1 -- 172.21.15.115:0/3693225679 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2cbc088e60 con 0x7f2cc809ddb0 2023-09-29T23:10:11.167 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:10:11.167 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:10:11.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.162+0000 7f2ccd66e700 10 mgrc shutdown 2023-09-29T23:10:11.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.162+0000 7f2ccd66e700 1 -- 172.21.15.115:0/3693225679 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2cb408e8b0 msgr2=0x7f2cb4090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:11.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.162+0000 7f2ccd66e700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2cb408e8b0 0x7f2cb4090d60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0007fd0 tx=0x7f2cc0009040 comp rx=0 tx=0).stop 2023-09-29T23:10:11.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.162+0000 7f2ccd66e700 1 -- 172.21.15.115:0/3693225679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cc809ddb0 msgr2=0x7f2cc806e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:11.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.162+0000 7f2ccd66e700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cc809ddb0 0x7f2cc806e6b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00c7e0 tx=0x7f2cbc007df0 comp rx=0 tx=0).stop 2023-09-29T23:10:11.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.162+0000 7f2ccd66e700 1 -- 172.21.15.115:0/3693225679 shutdown_connections 2023-09-29T23:10:11.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.162+0000 7f2ccd66e700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc813d700 0x7f2cc8098680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:11.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.162+0000 7f2ccd66e700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cc809ddb0 0x7f2cc806e6b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:11.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.162+0000 7f2ccd66e700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f2cb408e8b0 0x7f2cb4090d60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:11.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.162+0000 7f2ccd66e700 1 --2- 172.21.15.115:0/3693225679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc809d9e0 0x7f2cc813bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:11.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.162+0000 7f2ccd66e700 1 -- 172.21.15.115:0/3693225679 >> 172.21.15.115:0/3693225679 conn(0x7f2cc80b1d20 msgr2=0x7f2cc80677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:11.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.166+0000 7f2ccd66e700 1 -- 172.21.15.115:0/3693225679 shutdown_connections 2023-09-29T23:10:11.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:11.166+0000 7f2ccd66e700 1 -- 172.21.15.115:0/3693225679 wait complete. 2023-09-29T23:10:14.187 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:10:14.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.294+0000 7fda7eec2700 1 Processor -- start 2023-09-29T23:10:14.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.294+0000 7fda7eec2700 1 -- start start 2023-09-29T23:10:14.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fda780a32d0 0x7fda7809e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:14.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fda780a36a0 0x7fda7809c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:14.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda780a0f50 0x7fda780670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7813c6b0 con 0x7fda780a36a0 2023-09-29T23:10:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7813fd50 con 0x7fda780a32d0 2023-09-29T23:10:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7813fff0 con 0x7fda780a0f50 2023-09-29T23:10:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7e6c1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda780a0f50 0x7fda780670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7e6c1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda780a0f50 0x7fda780670a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:57846/0 (socket says 172.21.15.115:57846) 2023-09-29T23:10:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7e6c1700 1 -- 172.21.15.115:0/696957458 learned_addr learned my addr 172.21.15.115:0/696957458 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:10:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7d6bf700 1 --2- 172.21.15.115:0/696957458 >> v2:172.21.15.115:3300/0 conn(0x7fda780a36a0 0x7fda7809c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7dec0700 1 --2- 172.21.15.115:0/696957458 >> v2:172.21.15.156:3300/0 conn(0x7fda780a32d0 0x7fda7809e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7e6c1700 1 -- 172.21.15.115:0/696957458 >> v2:172.21.15.156:3300/0 conn(0x7fda780a32d0 msgr2=0x7fda7809e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:10:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7e6c1700 1 --2- 172.21.15.115:0/696957458 >> v2:172.21.15.156:3300/0 conn(0x7fda780a32d0 0x7fda7809e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:14.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7e6c1700 1 -- 172.21.15.115:0/696957458 >> v2:172.21.15.115:3300/0 conn(0x7fda780a36a0 msgr2=0x7fda7809c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:10:14.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7e6c1700 1 --2- 172.21.15.115:0/696957458 >> v2:172.21.15.115:3300/0 conn(0x7fda780a36a0 0x7fda7809c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:14.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7e6c1700 1 -- 172.21.15.115:0/696957458 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda78140290 con 0x7fda780a0f50 2023-09-29T23:10:14.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7dec0700 1 --2- 172.21.15.115:0/696957458 >> v2:172.21.15.156:3300/0 conn(0x7fda780a32d0 0x7fda7809e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:10:14.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7d6bf700 1 --2- 172.21.15.115:0/696957458 >> v2:172.21.15.115:3300/0 conn(0x7fda780a36a0 0x7fda7809c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:10:14.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7e6c1700 1 --2- 172.21.15.115:0/696957458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda780a0f50 0x7fda780670a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda740099b0 tx=0x7fda74009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d51cff977148300 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:14.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7cebe700 1 -- 172.21.15.115:0/696957458 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7400b820 con 0x7fda780a0f50 2023-09-29T23:10:14.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7cebe700 1 -- 172.21.15.115:0/696957458 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7400b980 con 0x7fda780a0f50 2023-09-29T23:10:14.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7cebe700 1 -- 172.21.15.115:0/696957458 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7400bd20 con 0x7fda780a0f50 2023-09-29T23:10:14.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 -- 172.21.15.115:0/696957458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda780a0f50 msgr2=0x7fda780670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:14.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 --2- 172.21.15.115:0/696957458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda780a0f50 0x7fda780670a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda740099b0 tx=0x7fda74009250 comp rx=0 tx=0).stop 2023-09-29T23:10:14.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 -- 172.21.15.115:0/696957458 shutdown_connections 2023-09-29T23:10:14.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 --2- 172.21.15.115:0/696957458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda780a0f50 0x7fda780670a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:14.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 --2- 172.21.15.115:0/696957458 >> v2:172.21.15.115:3300/0 conn(0x7fda780a36a0 0x7fda7809c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:14.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 --2- 172.21.15.115:0/696957458 >> v2:172.21.15.156:3300/0 conn(0x7fda780a32d0 0x7fda7809e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:14.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 -- 172.21.15.115:0/696957458 >> 172.21.15.115:0/696957458 conn(0x7fda780b1d20 msgr2=0x7fda780b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:14.309 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 -- 172.21.15.115:0/696957458 shutdown_connections 2023-09-29T23:10:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 -- 172.21.15.115:0/696957458 wait complete. 2023-09-29T23:10:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 Processor -- start 2023-09-29T23:10:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.298+0000 7fda7eec2700 1 -- start start 2023-09-29T23:10:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7eec2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda780a0f50 0x7fda780951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7eec2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda780a32d0 0x7fda7806d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7eec2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda780a36a0 0x7fda7806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7eec2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7806e330 con 0x7fda780a0f50 2023-09-29T23:10:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7eec2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7806e540 con 0x7fda780a36a0 2023-09-29T23:10:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7eec2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7806e800 con 0x7fda780a32d0 2023-09-29T23:10:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7dec0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda780a0f50 0x7fda780951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:14.310 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7dec0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda780a0f50 0x7fda780951f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51534/0 (socket says 172.21.15.115:51534) 2023-09-29T23:10:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7dec0700 1 -- 172.21.15.115:0/2211579232 learned_addr learned my addr 172.21.15.115:0/2211579232 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:10:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7d6bf700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda780a32d0 0x7fda7806d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7e6c1700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda780a36a0 0x7fda7806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7dec0700 1 -- 172.21.15.115:0/2211579232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda780a32d0 msgr2=0x7fda7806d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7dec0700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda780a32d0 0x7fda7806d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7dec0700 1 -- 172.21.15.115:0/2211579232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda780a36a0 msgr2=0x7fda7806ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7dec0700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda780a36a0 0x7fda7806ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7dec0700 1 -- 172.21.15.115:0/2211579232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda740094f0 con 0x7fda780a0f50 2023-09-29T23:10:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7d6bf700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda780a32d0 0x7fda7806d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:10:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7dec0700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda780a0f50 0x7fda780951f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fda7000d1d0 tx=0x7fda70009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:14.311 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda6dffb700 1 -- 172.21.15.115:0/2211579232 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000dd10 con 0x7fda780a0f50 2023-09-29T23:10:14.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda6dffb700 1 -- 172.21.15.115:0/2211579232 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7000f040 con 0x7fda780a0f50 2023-09-29T23:10:14.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7eec2700 1 -- 172.21.15.115:0/2211579232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda78095730 con 0x7fda780a0f50 2023-09-29T23:10:14.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda6dffb700 1 -- 172.21.15.115:0/2211579232 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70015670 con 0x7fda780a0f50 2023-09-29T23:10:14.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7eec2700 1 -- 172.21.15.115:0/2211579232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7813a8a0 con 0x7fda780a0f50 2023-09-29T23:10:14.312 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.302+0000 7fda7eec2700 1 -- 172.21.15.115:0/2211579232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda78095970 con 0x7fda780a0f50 2023-09-29T23:10:14.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.306+0000 7fda6dffb700 1 -- 172.21.15.115:0/2211579232 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fda70015a60 con 0x7fda780a0f50 2023-09-29T23:10:14.313 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.306+0000 7fda6dffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:10:14.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.306+0000 7fda6dffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:10:14.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.306+0000 7fda6dffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:14.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.306+0000 7fda6dffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:14.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.306+0000 7fda6dffb700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fda5c08e8b0 0x7fda5c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:14.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.306+0000 7fda6dffb700 1 -- 172.21.15.115:0/2211579232 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fda700b4c70 con 0x7fda780a0f50 2023-09-29T23:10:14.314 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.306+0000 7fda7d6bf700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fda5c08e8b0 0x7fda5c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:14.315 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.310+0000 7fda7d6bf700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fda5c08e8b0 0x7fda5c090d60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fda78143ed0 tx=0x7fda68008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:14.320 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.314+0000 7fda6dffb700 1 -- 172.21.15.115:0/2211579232 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fda78095970 con 0x7fda780a0f50 2023-09-29T23:10:14.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.510+0000 7fda7eec2700 1 -- 172.21.15.115:0/2211579232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fda78095920 con 0x7fda780a0f50 2023-09-29T23:10:14.517 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.510+0000 7fda6dffb700 1 -- 172.21.15.115:0/2211579232 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fda7001a100 con 0x7fda780a0f50 2023-09-29T23:10:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:10:14.518 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:10:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.514+0000 7fda7eec2700 10 mgrc shutdown 2023-09-29T23:10:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.514+0000 7fda7eec2700 1 -- 172.21.15.115:0/2211579232 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fda5c08e8b0 msgr2=0x7fda5c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.514+0000 7fda7eec2700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fda5c08e8b0 0x7fda5c090d60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fda78143ed0 tx=0x7fda68008040 comp rx=0 tx=0).stop 2023-09-29T23:10:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.514+0000 7fda7eec2700 1 -- 172.21.15.115:0/2211579232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda780a0f50 msgr2=0x7fda780951f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.514+0000 7fda7eec2700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda780a0f50 0x7fda780951f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fda7000d1d0 tx=0x7fda70009a90 comp rx=0 tx=0).stop 2023-09-29T23:10:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.514+0000 7fda7eec2700 1 -- 172.21.15.115:0/2211579232 shutdown_connections 2023-09-29T23:10:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.514+0000 7fda7eec2700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda780a36a0 0x7fda7806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.514+0000 7fda7eec2700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda780a32d0 0x7fda7806d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:14.520 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.514+0000 7fda7eec2700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7fda5c08e8b0 0x7fda5c090d60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:14.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.514+0000 7fda7eec2700 1 --2- 172.21.15.115:0/2211579232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda780a0f50 0x7fda780951f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:14.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.514+0000 7fda7eec2700 1 -- 172.21.15.115:0/2211579232 >> 172.21.15.115:0/2211579232 conn(0x7fda780b1d20 msgr2=0x7fda780a21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:14.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.514+0000 7fda7eec2700 1 -- 172.21.15.115:0/2211579232 shutdown_connections 2023-09-29T23:10:14.521 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:14.514+0000 7fda7eec2700 1 -- 172.21.15.115:0/2211579232 wait complete. 2023-09-29T23:10:17.532 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:10:17.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 Processor -- start 2023-09-29T23:10:17.643 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 -- start start 2023-09-29T23:10:17.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c00a6670 0x7f44c0141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:17.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f44c0141ab0 0x7f44c00a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:17.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c006f220 con 0x7f44c00a62a0 2023-09-29T23:10:17.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c0068790 con 0x7f44c0141ab0 2023-09-29T23:10:17.644 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c00a54a0 con 0x7f44c00a6670 2023-09-29T23:10:17.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44beffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c00a6670 0x7f44c0141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:17.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44bffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f44c0141ab0 0x7f44c00a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:17.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44bf7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f44c00a62a0 0x7f44c006e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.115:44808/0 (socket says 172.21.15.115:44808) 2023-09-29T23:10:17.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44bf7fe700 1 -- 172.21.15.115:0/997563279 learned_addr learned my addr 172.21.15.115:0/997563279 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:10:17.645 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44bffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f44c0141ab0 0x7f44c00a4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.115:48576/0 (socket says 172.21.15.115:48576) 2023-09-29T23:10:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44beffd700 1 -- 172.21.15.115:0/997563279 >> v2:172.21.15.156:3300/0 conn(0x7f44c0141ab0 msgr2=0x7f44c00a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:10:17.646 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44beffd700 1 --2- 172.21.15.115:0/997563279 >> v2:172.21.15.156:3300/0 conn(0x7f44c0141ab0 0x7f44c00a4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44beffd700 1 -- 172.21.15.115:0/997563279 >> v1:172.21.15.156:6789/0 conn(0x7f44c00a62a0 legacy=0x7f44c006e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44beffd700 1 -- 172.21.15.115:0/997563279 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c0140e60 con 0x7f44c00a6670 2023-09-29T23:10:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44beffd700 1 --2- 172.21.15.115:0/997563279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c00a6670 0x7f44c0141570 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f44b40098e0 tx=0x7f44b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd18b19fcc0b0768 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44be7fc700 1 -- 172.21.15.115:0/997563279 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b400b640 con 0x7f44c00a6670 2023-09-29T23:10:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44be7fc700 1 -- 172.21.15.115:0/997563279 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b400b7a0 con 0x7f44c00a6670 2023-09-29T23:10:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44be7fc700 1 -- 172.21.15.115:0/997563279 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b400bb40 con 0x7f44c00a6670 2023-09-29T23:10:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 -- 172.21.15.115:0/997563279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c00a6670 msgr2=0x7f44c0141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 --2- 172.21.15.115:0/997563279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c00a6670 0x7f44c0141570 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f44b40098e0 tx=0x7f44b40091a0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 -- 172.21.15.115:0/997563279 shutdown_connections 2023-09-29T23:10:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 --2- 172.21.15.115:0/997563279 >> v2:172.21.15.156:3300/0 conn(0x7f44c0141ab0 0x7f44c00a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 --2- 172.21.15.115:0/997563279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c00a6670 0x7f44c0141570 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 -- 172.21.15.115:0/997563279 >> 172.21.15.115:0/997563279 conn(0x7f44c00a3470 msgr2=0x7f44c00a3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:17.647 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 -- 172.21.15.115:0/997563279 shutdown_connections 2023-09-29T23:10:17.648 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.638+0000 7f44c4af7700 1 -- 172.21.15.115:0/997563279 wait complete. 2023-09-29T23:10:17.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.642+0000 7f44c4af7700 1 Processor -- start 2023-09-29T23:10:17.649 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.642+0000 7f44c4af7700 1 -- start start 2023-09-29T23:10:17.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.642+0000 7f44c4af7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44c00a62a0 0x7f44c01420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:17.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.642+0000 7f44c4af7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c00a6670 0x7f44c00ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:17.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44c4af7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c0141ab0 0x7f44c00ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:17.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44c4af7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c00ae8b0 con 0x7f44c0141ab0 2023-09-29T23:10:17.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44c4af7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c0142aa0 con 0x7f44c00a62a0 2023-09-29T23:10:17.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44c4af7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c0142d60 con 0x7f44c00a6670 2023-09-29T23:10:17.651 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44beffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c00a6670 0x7f44c00ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:17.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44beffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c00a6670 0x7f44c00ade30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:57876/0 (socket says 172.21.15.115:57876) 2023-09-29T23:10:17.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44beffd700 1 -- 172.21.15.115:0/82207664 learned_addr learned my addr 172.21.15.115:0/82207664 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:10:17.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44bffff700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c0141ab0 0x7f44c00ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:17.652 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44bf7fe700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44c00a62a0 0x7f44c01420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44beffd700 1 -- 172.21.15.115:0/82207664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44c00a62a0 msgr2=0x7f44c01420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44beffd700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44c00a62a0 0x7f44c01420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44beffd700 1 -- 172.21.15.115:0/82207664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c0141ab0 msgr2=0x7f44c00ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44beffd700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c0141ab0 0x7f44c00ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44beffd700 1 -- 172.21.15.115:0/82207664 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4009420 con 0x7f44c00a6670 2023-09-29T23:10:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44bffff700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c0141ab0 0x7f44c00ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:10:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44beffd700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c00a6670 0x7f44c00ade30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f44c00a55e0 tx=0x7f44b4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:17.653 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44a77fe700 1 -- 172.21.15.115:0/82207664 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b401bc00 con 0x7f44c00a6670 2023-09-29T23:10:17.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44a77fe700 1 -- 172.21.15.115:0/82207664 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b401bd80 con 0x7f44c00a6670 2023-09-29T23:10:17.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44c4af7700 1 -- 172.21.15.115:0/82207664 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c0143020 con 0x7f44c00a6670 2023-09-29T23:10:17.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44a77fe700 1 -- 172.21.15.115:0/82207664 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4011670 con 0x7f44c00a6670 2023-09-29T23:10:17.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44c4af7700 1 -- 172.21.15.115:0/82207664 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c00aa870 con 0x7f44c00a6670 2023-09-29T23:10:17.654 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.646+0000 7f44c4af7700 1 -- 172.21.15.115:0/82207664 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c004be00 con 0x7f44c00a6670 2023-09-29T23:10:17.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.650+0000 7f44a77fe700 1 -- 172.21.15.115:0/82207664 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f44b4011a20 con 0x7f44c00a6670 2023-09-29T23:10:17.655 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.650+0000 7f44a77fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:10:17.656 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.650+0000 7f44a77fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:10:17.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.650+0000 7f44a77fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:17.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.650+0000 7f44a77fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:17.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.650+0000 7f44a77fe700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f44ac08e8b0 0x7f44ac090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:17.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.650+0000 7f44a77fe700 1 -- 172.21.15.115:0/82207664 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f44b40b5d50 con 0x7f44c00a6670 2023-09-29T23:10:17.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.650+0000 7f44bf7fe700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f44ac08e8b0 0x7f44ac090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:17.657 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.650+0000 7f44bf7fe700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f44ac08e8b0 0x7f44ac090d60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f44b0001950 tx=0x7f44b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:17.664 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.658+0000 7f44a77fe700 1 -- 172.21.15.115:0/82207664 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f44b40b9030 con 0x7f44c00a6670 2023-09-29T23:10:17.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.858+0000 7f44c4af7700 1 -- 172.21.15.115:0/82207664 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f44c00a57e0 con 0x7f44c00a6670 2023-09-29T23:10:17.863 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.858+0000 7f44a77fe700 1 -- 172.21.15.115:0/82207664 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f44b4086780 con 0x7f44c00a6670 2023-09-29T23:10:17.863 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:10:17.864 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:10:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.862+0000 7f44c4af7700 10 mgrc shutdown 2023-09-29T23:10:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.862+0000 7f44c4af7700 1 -- 172.21.15.115:0/82207664 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f44ac08e8b0 msgr2=0x7f44ac090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:17.868 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.862+0000 7f44c4af7700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f44ac08e8b0 0x7f44ac090d60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f44b0001950 tx=0x7f44b0009040 comp rx=0 tx=0).stop 2023-09-29T23:10:17.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.862+0000 7f44c4af7700 1 -- 172.21.15.115:0/82207664 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c00a6670 msgr2=0x7f44c00ade30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:17.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.862+0000 7f44c4af7700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c00a6670 0x7f44c00ade30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f44c00a55e0 tx=0x7f44b4017000 comp rx=0 tx=0).stop 2023-09-29T23:10:17.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.862+0000 7f44c4af7700 1 -- 172.21.15.115:0/82207664 shutdown_connections 2023-09-29T23:10:17.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.862+0000 7f44c4af7700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f44ac08e8b0 0x7f44ac090d60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.862+0000 7f44c4af7700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c0141ab0 0x7f44c00ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.862+0000 7f44c4af7700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c00a6670 0x7f44c00ade30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.869 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.862+0000 7f44c4af7700 1 --2- 172.21.15.115:0/82207664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44c00a62a0 0x7f44c01420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.862+0000 7f44c4af7700 1 -- 172.21.15.115:0/82207664 >> 172.21.15.115:0/82207664 conn(0x7f44c00a3470 msgr2=0x7f44c013df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:17.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.862+0000 7f44c4af7700 1 -- 172.21.15.115:0/82207664 shutdown_connections 2023-09-29T23:10:17.870 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.862+0000 7f44c4af7700 1 -- 172.21.15.115:0/82207664 wait complete. 2023-09-29T23:10:17.882 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-09-29T23:10:17.882 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:10:17.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.978+0000 7f883140b700 1 Processor -- start 2023-09-29T23:10:17.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 -- start start 2023-09-29T23:10:17.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f882c09d9e0 0x7f882c140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:17.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f882c09ddb0 0x7f882c09f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:17.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882c13e770 con 0x7f882c13d700 2023-09-29T23:10:17.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882c141d20 con 0x7f882c09ddb0 2023-09-29T23:10:17.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882c13dc00 con 0x7f882c09d9e0 2023-09-29T23:10:17.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f882b7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f882c09ddb0 0x7f882c09f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:17.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f8830c0a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f882c13d700 0x7f882c141610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49528/0 (socket says 172.21.15.115:49528) 2023-09-29T23:10:17.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f8830c0a700 1 -- 172.21.15.115:0/4040076551 learned_addr learned my addr 172.21.15.115:0/4040076551 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:10:17.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f882bfff700 1 --2- 172.21.15.115:0/4040076551 >> v2:172.21.15.156:3300/0 conn(0x7f882c09d9e0 0x7f882c140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:17.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f882b7fe700 1 -- 172.21.15.115:0/4040076551 >> v2:172.21.15.156:3300/0 conn(0x7f882c09d9e0 msgr2=0x7f882c140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:10:17.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f882b7fe700 1 --2- 172.21.15.115:0/4040076551 >> v2:172.21.15.156:3300/0 conn(0x7f882c09d9e0 0x7f882c140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f882b7fe700 1 -- 172.21.15.115:0/4040076551 >> v1:172.21.15.115:6789/0 conn(0x7f882c13d700 legacy=0x7f882c141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:17.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f882affd700 1 -- 172.21.15.115:0/4040076551 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762355274 0 0) 0x7f882c13e770 con 0x7f882c13d700 2023-09-29T23:10:17.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f882b7fe700 1 -- 172.21.15.115:0/4040076551 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c13dec0 con 0x7f882c09ddb0 2023-09-29T23:10:17.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f882b7fe700 1 --2- 172.21.15.115:0/4040076551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f882c09ddb0 0x7f882c09f640 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f882c06b300 tx=0x7f88200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c307332d0f5ba7e server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:17.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f882affd700 1 -- 172.21.15.115:0/4040076551 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882000b690 con 0x7f882c09ddb0 2023-09-29T23:10:17.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f882affd700 1 -- 172.21.15.115:0/4040076551 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882000b7f0 con 0x7f882c09ddb0 2023-09-29T23:10:17.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f882affd700 1 -- 172.21.15.115:0/4040076551 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882000bb90 con 0x7f882c09ddb0 2023-09-29T23:10:17.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 -- 172.21.15.115:0/4040076551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f882c09ddb0 msgr2=0x7f882c09f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:17.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 --2- 172.21.15.115:0/4040076551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f882c09ddb0 0x7f882c09f640 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f882c06b300 tx=0x7f88200091a0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 -- 172.21.15.115:0/4040076551 shutdown_connections 2023-09-29T23:10:17.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 --2- 172.21.15.115:0/4040076551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f882c09ddb0 0x7f882c09f640 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 --2- 172.21.15.115:0/4040076551 >> v2:172.21.15.156:3300/0 conn(0x7f882c09d9e0 0x7f882c140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 -- 172.21.15.115:0/4040076551 >> 172.21.15.115:0/4040076551 conn(0x7f882c0b1d20 msgr2=0x7f882c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:17.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 -- 172.21.15.115:0/4040076551 shutdown_connections 2023-09-29T23:10:17.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.982+0000 7f883140b700 1 -- 172.21.15.115:0/4040076551 wait complete. 2023-09-29T23:10:17.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.986+0000 7f883140b700 1 Processor -- start 2023-09-29T23:10:17.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.986+0000 7f883140b700 1 -- start start 2023-09-29T23:10:17.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.986+0000 7f883140b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f882c09d9e0 0x7f882c09c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:17.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.986+0000 7f883140b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f882c09ddb0 0x7f882c14ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:17.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.986+0000 7f883140b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f882c13d700 0x7f882c14f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:17.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.986+0000 7f883140b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c13c6c0 con 0x7f882c13d700 2023-09-29T23:10:17.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.986+0000 7f883140b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c09a540 con 0x7f882c09d9e0 2023-09-29T23:10:17.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.986+0000 7f883140b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882c09a700 con 0x7f882c09ddb0 2023-09-29T23:10:17.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.986+0000 7f8830c0a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f882c13d700 0x7f882c14f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:17.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f8830c0a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f882c13d700 0x7f882c14f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51550/0 (socket says 172.21.15.115:51550) 2023-09-29T23:10:17.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f8830c0a700 1 -- 172.21.15.115:0/1453575334 learned_addr learned my addr 172.21.15.115:0/1453575334 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:10:17.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f882bfff700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f882c09d9e0 0x7f882c09c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:17.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f882b7fe700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f882c09ddb0 0x7f882c14ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:17.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f8830c0a700 1 -- 172.21.15.115:0/1453575334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f882c09ddb0 msgr2=0x7f882c14ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:17.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f8830c0a700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f882c09ddb0 0x7f882c14ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f8830c0a700 1 -- 172.21.15.115:0/1453575334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f882c09d9e0 msgr2=0x7f882c09c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:17.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f8830c0a700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f882c09d9e0 0x7f882c09c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:17.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f8830c0a700 1 -- 172.21.15.115:0/1453575334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8820009420 con 0x7f882c13d700 2023-09-29T23:10:17.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f8830c0a700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f882c13d700 0x7f882c14f470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f881c00c560 tx=0x7f881c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:17.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f8813fff700 1 -- 172.21.15.115:0/1453575334 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c005b30 con 0x7f882c13d700 2023-09-29T23:10:17.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f8813fff700 1 -- 172.21.15.115:0/1453575334 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c005c90 con 0x7f882c13d700 2023-09-29T23:10:17.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f883140b700 1 -- 172.21.15.115:0/1453575334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882c0a6170 con 0x7f882c13d700 2023-09-29T23:10:17.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f8813fff700 1 -- 172.21.15.115:0/1453575334 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c007320 con 0x7f882c13d700 2023-09-29T23:10:17.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f883140b700 1 -- 172.21.15.115:0/1453575334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882c0a66e0 con 0x7f882c13d700 2023-09-29T23:10:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.990+0000 7f883140b700 1 -- 172.21.15.115:0/1453575334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882c13b750 con 0x7f882c13d700 2023-09-29T23:10:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.994+0000 7f8813fff700 1 -- 172.21.15.115:0/1453575334 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f881c01b3b0 con 0x7f882c13d700 2023-09-29T23:10:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.994+0000 7f8813fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:10:18.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.994+0000 7f8813fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:10:18.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.994+0000 7f8813fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:18.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.994+0000 7f8813fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:18.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.994+0000 7f8813fff700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f881808e8b0 0x7f8818090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:18.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.994+0000 7f8813fff700 1 -- 172.21.15.115:0/1453575334 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f881c0b3c20 con 0x7f882c13d700 2023-09-29T23:10:18.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.994+0000 7f882bfff700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f881808e8b0 0x7f8818090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:18.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:17.994+0000 7f882bfff700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f881808e8b0 0x7f8818090d60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8824009fd0 tx=0x7f882400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:18.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.002+0000 7f8813fff700 1 -- 172.21.15.115:0/1453575334 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f882c13b750 con 0x7f882c13d700 2023-09-29T23:10:18.168 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.162+0000 7f883140b700 1 -- 172.21.15.115:0/1453575334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f882c13b750 con 0x7f882c13d700 2023-09-29T23:10:18.169 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.162+0000 7f8813fff700 1 -- 172.21.15.115:0/1453575334 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+12443 (secure 0 0 0) 0x7f882c13b750 con 0x7f882c13d700 2023-09-29T23:10:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-29T23:10:18.170 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"fsid":"593687ae-01c7-4a32-a91e-931db75fb751","created":"2023-09-29T23:04:48.574873+0000","modified":"2023-09-29T23:05:54.524455+0000","last_up_change":"2023-09-29T23:04:53.614158+0000","last_in_change":"2023-09-29T23:04:50.489116+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-29T23:04:54.900033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-29T23:04:58.342574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-29T23:05:02.595115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-29T23:05:03.183110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9da0e8c9-ea18-4691-87ef-fbf5502845a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":26662},{"type":"v1","addr":"172.21.15.115:6801","nonce":26662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":26662},{"type":"v1","addr":"172.21.15.115:6803","nonce":26662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":26662},{"type":"v1","addr":"172.21.15.115:6807","nonce":26662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":26662},{"type":"v1","addr":"172.21.15.115:6805","nonce":26662}]},"public_addr":"172.21.15.115:6801/26662","cluster_addr":"172.21.15.115:6803/26662","heartbeat_back_addr":"172.21.15.115:6807/26662","heartbeat_front_addr":"172.21.15.115:6805/26662","state":["exists","up"]},{"osd":1,"uuid":"eaaa380c-73da-4075-992d-ab16b36d8ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":26874},{"type":"v1","addr":"172.21.15.156:6801","nonce":26874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":26874},{"type":"v1","addr":"172.21.15.156:6803","nonce":26874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":26874},{"type":"v1","addr":"172.21.15.156:6807","nonce":26874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":26874},{"type":"v1","addr":"172.21.15.156:6805","nonce":26874}]},"public_addr":"172.21.15.156:6801/26874","cluster_addr":"172.21.15.156:6803/26874","heartbeat_back_addr":"172.21.15.156:6807/26874","heartbeat_front_addr":"172.21.15.156:6805/26874","state":["exists","up"]},{"osd":2,"uuid":"01e8286e-30af-41c7-bcd1-c4545f9f0a14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":26873},{"type":"v1","addr":"172.21.15.156:6809","nonce":26873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":26873},{"type":"v1","addr":"172.21.15.156:6811","nonce":26873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":26873},{"type":"v1","addr":"172.21.15.156:6817","nonce":26873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":26873},{"type":"v1","addr":"172.21.15.156:6813","nonce":26873}]},"public_addr":"172.21.15.156:6809/26873","cluster_addr":"172.21.15.156:6811/26873","heartbeat_back_addr":"172.21.15.156:6817/26873","heartbeat_front_addr":"172.21.15.156:6813/26873","state":["exists","up"]},{"osd":3,"uuid":"4f6a1234-5ac6-43b0-baaa-3567ab7c73a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6815","nonce":26875},{"type":"v1","addr":"172.21.15.156:6816","nonce":26875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":26875},{"type":"v1","addr":"172.21.15.156:6819","nonce":26875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":26875},{"type":"v1","addr":"172.21.15.156:6823","nonce":26875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":26875},{"type":"v1","addr":"172.21.15.156:6821","nonce":26875}]},"public_addr":"172.21.15.156:6816/26875","cluster_addr":"172.21.15.156:6819/26875","heartbeat_back_addr":"172.21.15.156:6823/26875","heartbeat_front_addr":"172.21.15.156:6821/26875","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.582513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.686413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:04:51.608933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":0,"to":2}]},{"pgid":"4.28","mappings":[{"from":0,"to":2}]},{"pgid":"4.2b","mappings":[{"from":0,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:10:18.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.162+0000 7f883140b700 10 mgrc shutdown 2023-09-29T23:10:18.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.162+0000 7f883140b700 1 -- 172.21.15.115:0/1453575334 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f881808e8b0 msgr2=0x7f8818090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:18.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.162+0000 7f883140b700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f881808e8b0 0x7f8818090d60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8824009fd0 tx=0x7f882400b040 comp rx=0 tx=0).stop 2023-09-29T23:10:18.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.162+0000 7f883140b700 1 -- 172.21.15.115:0/1453575334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f882c13d700 msgr2=0x7f882c14f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:18.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.162+0000 7f883140b700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f882c13d700 0x7f882c14f470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f881c00c560 tx=0x7f881c007f90 comp rx=0 tx=0).stop 2023-09-29T23:10:18.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.166+0000 7f883140b700 1 -- 172.21.15.115:0/1453575334 shutdown_connections 2023-09-29T23:10:18.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.166+0000 7f883140b700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f881808e8b0 0x7f8818090d60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.166+0000 7f883140b700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f882c13d700 0x7f882c14f470 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.166+0000 7f883140b700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f882c09ddb0 0x7f882c14ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.166+0000 7f883140b700 1 --2- 172.21.15.115:0/1453575334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f882c09d9e0 0x7f882c09c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.166+0000 7f883140b700 1 -- 172.21.15.115:0/1453575334 >> 172.21.15.115:0/1453575334 conn(0x7f882c0b1d20 msgr2=0x7f882c069260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:18.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.166+0000 7f883140b700 1 -- 172.21.15.115:0/1453575334 shutdown_connections 2023-09-29T23:10:18.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.166+0000 7f883140b700 1 -- 172.21.15.115:0/1453575334 wait complete. 2023-09-29T23:10:18.184 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-29T23:10:18.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.282+0000 7f89df59e700 1 Processor -- start 2023-09-29T23:10:18.290 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.282+0000 7f89df59e700 1 -- start start 2023-09-29T23:10:18.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.282+0000 7f89df59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f89e00b17b0 0x7f89e01477f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:18.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89df59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f89e0147d30 0x7f89e0143520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:18.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89df59e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e00b1b80 con 0x7f89e0143a60 2023-09-29T23:10:18.293 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89df59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e00b1170 con 0x7f89e00b17b0 2023-09-29T23:10:18.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89df59e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e00b2ac0 con 0x7f89e0147d30 2023-09-29T23:10:18.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89de59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f89e00b17b0 0x7f89e01477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:18.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89ded9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f89e0143a60 0x7f89e00b04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:49532/0 (socket says 172.21.15.115:49532) 2023-09-29T23:10:18.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89ded9d700 1 -- 172.21.15.115:0/3082142925 learned_addr learned my addr 172.21.15.115:0/3082142925 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-09-29T23:10:18.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89ddd9b700 1 --2- 172.21.15.115:0/3082142925 >> v2:172.21.15.156:3300/0 conn(0x7f89e0147d30 0x7f89e0143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:18.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 <== mon.0 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205460888 0 0) 0x7f89e00b1b80 con 0x7f89e0143a60 2023-09-29T23:10:18.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89cc003570 con 0x7f89e0143a60 2023-09-29T23:10:18.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 <== mon.0 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 644242048 0 0) 0x7f89cc003570 con 0x7f89e0143a60 2023-09-29T23:10:18.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 >> v2:172.21.15.156:3300/0 conn(0x7f89e0147d30 msgr2=0x7f89e0143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:10:18.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 --2- 172.21.15.115:0/3082142925 >> v2:172.21.15.156:3300/0 conn(0x7f89e0147d30 0x7f89e0143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 >> v2:172.21.15.115:3300/0 conn(0x7f89e00b17b0 msgr2=0x7f89e01477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:10:18.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 --2- 172.21.15.115:0/3082142925 >> v2:172.21.15.115:3300/0 conn(0x7f89e00b17b0 0x7f89e01477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e00b0bf0 con 0x7f89e0143a60 2023-09-29T23:10:18.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 <== mon.0 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3987234196 0 0) 0x7f89d0001470 con 0x7f89e0143a60 2023-09-29T23:10:18.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 >> v1:172.21.15.115:6789/0 conn(0x7f89e0143a60 legacy=0x7f89e00b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:18.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 --2- 172.21.15.115:0/3082142925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89cc003a60 0x7f89cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:18.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 --2- 172.21.15.115:0/3082142925 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89cc004810 0x7f89cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:18.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 --2- 172.21.15.115:0/3082142925 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89cc0051c0 0x7f89cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:18.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00b1170 con 0x7f89cc0051c0 2023-09-29T23:10:18.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00b2ac0 con 0x7f89cc003a60 2023-09-29T23:10:18.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc00bfd0 con 0x7f89cc004810 2023-09-29T23:10:18.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89de59c700 1 --2- 172.21.15.115:0/3082142925 >> v2:172.21.15.115:3300/0 conn(0x7f89e00b17b0 0x7f89e01477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-29T23:10:18.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89ddd9b700 1 --2- 172.21.15.115:0/3082142925 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89cc004810 0x7f89cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:18.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89ded9d700 1 --2- 172.21.15.115:0/3082142925 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89cc0051c0 0x7f89cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:18.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89de59c700 1 --2- 172.21.15.115:0/3082142925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89cc003a60 0x7f89cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:18.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89ddd9b700 1 -- 172.21.15.115:0/3082142925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89cc003a60 msgr2=0x7f89cc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:10:18.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89ddd9b700 1 --2- 172.21.15.115:0/3082142925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89cc003a60 0x7f89cc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89ddd9b700 1 -- 172.21.15.115:0/3082142925 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89cc0051c0 msgr2=0x7f89cc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-29T23:10:18.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89ddd9b700 1 --2- 172.21.15.115:0/3082142925 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89cc0051c0 0x7f89cc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89ddd9b700 1 -- 172.21.15.115:0/3082142925 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc003570 con 0x7f89cc004810 2023-09-29T23:10:18.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89ded9d700 1 --2- 172.21.15.115:0/3082142925 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89cc0051c0 0x7f89cc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-29T23:10:18.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89ded9d700 1 -- 172.21.15.115:0/3082142925 reap_dead start 2023-09-29T23:10:18.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89ddd9b700 1 --2- 172.21.15.115:0/3082142925 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89cc004810 0x7f89cc004c80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f89c8006f00 tx=0x7f89c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6b43be1aac10ffe server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:18.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c800e6b0 con 0x7f89cc004810 2023-09-29T23:10:18.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c800e810 con 0x7f89cc004810 2023-09-29T23:10:18.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89dd59a700 1 -- 172.21.15.115:0/3082142925 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c800ebd0 con 0x7f89cc004810 2023-09-29T23:10:18.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89df59e700 1 -- 172.21.15.115:0/3082142925 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89cc004810 msgr2=0x7f89cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:18.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89df59e700 1 --2- 172.21.15.115:0/3082142925 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89cc004810 0x7f89cc004c80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f89c8006f00 tx=0x7f89c80091a0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89df59e700 1 -- 172.21.15.115:0/3082142925 shutdown_connections 2023-09-29T23:10:18.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89df59e700 1 --2- 172.21.15.115:0/3082142925 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89cc004810 0x7f89cc004c80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89df59e700 1 -- 172.21.15.115:0/3082142925 >> 172.21.15.115:0/3082142925 conn(0x7f89e0069d90 msgr2=0x7f89e00670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:18.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89df59e700 1 -- 172.21.15.115:0/3082142925 shutdown_connections 2023-09-29T23:10:18.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.286+0000 7f89df59e700 1 -- 172.21.15.115:0/3082142925 wait complete. 2023-09-29T23:10:18.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89df59e700 1 Processor -- start 2023-09-29T23:10:18.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89df59e700 1 -- start start 2023-09-29T23:10:18.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89df59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89cc004810 0x7f89e0141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:18.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89df59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e0094a00 0x7f89e00a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:18.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89df59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89e0153c40 0x7f89e01540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:18.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89df59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e006def0 con 0x7f89cc004810 2023-09-29T23:10:18.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89df59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e006e9c0 con 0x7f89e0153c40 2023-09-29T23:10:18.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89df59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e0154900 con 0x7f89e0094a00 2023-09-29T23:10:18.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89de59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89cc004810 0x7f89e0141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:18.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89ddd9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e0094a00 0x7f89e00a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:18.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89de59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89cc004810 0x7f89e0141d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51584/0 (socket says 172.21.15.115:51584) 2023-09-29T23:10:18.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89de59c700 1 -- 172.21.15.115:0/1206214302 learned_addr learned my addr 172.21.15.115:0/1206214302 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-09-29T23:10:18.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89ded9d700 1 --2- 172.21.15.115:0/1206214302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89e0153c40 0x7f89e01540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:18.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89de59c700 1 -- 172.21.15.115:0/1206214302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e0094a00 msgr2=0x7f89e00a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:18.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89de59c700 1 --2- 172.21.15.115:0/1206214302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e0094a00 0x7f89e00a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89de59c700 1 -- 172.21.15.115:0/1206214302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89e0153c40 msgr2=0x7f89e01540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:18.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89de59c700 1 --2- 172.21.15.115:0/1206214302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89e0153c40 0x7f89e01540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89de59c700 1 -- 172.21.15.115:0/1206214302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e0154bc0 con 0x7f89cc004810 2023-09-29T23:10:18.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89de59c700 1 --2- 172.21.15.115:0/1206214302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89cc004810 0x7f89e0141d10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f89d8011580 tx=0x7f89d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:18.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89d67fc700 1 -- 172.21.15.115:0/1206214302 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800e030 con 0x7f89cc004810 2023-09-29T23:10:18.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89d67fc700 1 -- 172.21.15.115:0/1206214302 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d8016470 con 0x7f89cc004810 2023-09-29T23:10:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89df59e700 1 -- 172.21.15.115:0/1206214302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e0154600 con 0x7f89cc004810 2023-09-29T23:10:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89d67fc700 1 -- 172.21.15.115:0/1206214302 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d80167f0 con 0x7f89cc004810 2023-09-29T23:10:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89df59e700 1 -- 172.21.15.115:0/1206214302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e006e360 con 0x7f89cc004810 2023-09-29T23:10:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.290+0000 7f89df59e700 1 -- 172.21.15.115:0/1206214302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e004be00 con 0x7f89cc004810 2023-09-29T23:10:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.294+0000 7f89d67fc700 1 -- 172.21.15.115:0/1206214302 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f89d8016ba0 con 0x7f89cc004810 2023-09-29T23:10:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.294+0000 7f89d67fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-29T23:10:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.294+0000 7f89d67fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-29T23:10:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.294+0000 7f89d67fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.294+0000 7f89d67fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] 2023-09-29T23:10:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.294+0000 7f89d67fc700 1 --2- 172.21.15.115:0/1206214302 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f89c008e8b0 0x7f89c0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:10:18.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.294+0000 7f89d67fc700 1 -- 172.21.15.115:0/1206214302 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f89d800f070 con 0x7f89cc004810 2023-09-29T23:10:18.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.294+0000 7f89ddd9b700 1 --2- 172.21.15.115:0/1206214302 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f89c008e8b0 0x7f89c0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:10:18.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.294+0000 7f89ddd9b700 1 --2- 172.21.15.115:0/1206214302 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f89c008e8b0 0x7f89c0090d60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f89c80091e0 tx=0x7f89c801a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:10:18.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.298+0000 7f89d67fc700 1 -- 172.21.15.115:0/1206214302 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f89d8054be0 con 0x7f89cc004810 2023-09-29T23:10:18.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.458+0000 7f89df59e700 1 -- 172.21.15.115:0/1206214302 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f89e00b0e40 con 0x7f89cc004810 2023-09-29T23:10:18.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.466+0000 7f89d67fc700 1 -- 172.21.15.115:0/1206214302 <== mon.0 v2:172.21.15.115:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f89d808a370 con 0x7f89cc004810 2023-09-29T23:10:18.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.466+0000 7f89d67fc700 1 -- 172.21.15.115:0/1206214302 <== mon.0 v2:172.21.15.115:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f89d8089f00 con 0x7f89cc004810 2023-09-29T23:10:18.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.470+0000 7f89df59e700 10 mgrc shutdown 2023-09-29T23:10:18.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.470+0000 7f89df59e700 1 -- 172.21.15.115:0/1206214302 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f89c008e8b0 msgr2=0x7f89c0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:18.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.470+0000 7f89df59e700 1 --2- 172.21.15.115:0/1206214302 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f89c008e8b0 0x7f89c0090d60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f89c80091e0 tx=0x7f89c801a000 comp rx=0 tx=0).stop 2023-09-29T23:10:18.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.470+0000 7f89df59e700 1 -- 172.21.15.115:0/1206214302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89cc004810 msgr2=0x7f89e0141d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:10:18.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.470+0000 7f89df59e700 1 --2- 172.21.15.115:0/1206214302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89cc004810 0x7f89e0141d10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f89d8011580 tx=0x7f89d800b040 comp rx=0 tx=0).stop 2023-09-29T23:10:18.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.470+0000 7f89df59e700 1 -- 172.21.15.115:0/1206214302 shutdown_connections 2023-09-29T23:10:18.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.470+0000 7f89df59e700 1 --2- 172.21.15.115:0/1206214302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f89e0153c40 0x7f89e01540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.470+0000 7f89df59e700 1 --2- 172.21.15.115:0/1206214302 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89e0094a00 0x7f89e00a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.470+0000 7f89df59e700 1 --2- 172.21.15.115:0/1206214302 >> [v2:172.21.15.156:6824/26644,v1:172.21.15.156:6825/26644] conn(0x7f89c008e8b0 0x7f89c0090d60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.470+0000 7f89df59e700 1 --2- 172.21.15.115:0/1206214302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89cc004810 0x7f89e0141d10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:10:18.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.470+0000 7f89df59e700 1 -- 172.21.15.115:0/1206214302 >> 172.21.15.115:0/1206214302 conn(0x7f89e0069d90 msgr2=0x7f89e0142e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:10:18.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.470+0000 7f89df59e700 1 -- 172.21.15.115:0/1206214302 shutdown_connections 2023-09-29T23:10:18.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-09-29T23:10:18.470+0000 7f89df59e700 1 -- 172.21.15.115:0/1206214302 wait complete. 2023-09-29T23:10:18.492 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1895, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1472, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph_manager.py", line 3189, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2023-09-29T23:10:18.494 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-29T23:10:18.494 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-29T23:10:18.495 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:10:18.504 INFO:tasks.ceph.mds.a:Stopped 2023-09-29T23:10:18.504 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-29T23:10:18.504 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:10:18.516 INFO:tasks.ceph.mds.c:Stopped 2023-09-29T23:10:18.517 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-29T23:10:18.517 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:10:18.533 INFO:tasks.ceph.mds.b:Stopped 2023-09-29T23:10:18.534 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-29T23:10:18.534 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-29T23:10:18.534 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:10:18.552 INFO:tasks.ceph.osd.0:Stopped 2023-09-29T23:10:18.552 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-29T23:10:18.552 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:10:18.571 INFO:tasks.ceph.osd.1:Stopped 2023-09-29T23:10:18.571 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-29T23:10:18.571 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:10:18.588 INFO:tasks.ceph.osd.2:Stopped 2023-09-29T23:10:18.589 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-29T23:10:18.589 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:10:18.603 INFO:tasks.ceph.osd.3:Stopped 2023-09-29T23:10:18.603 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-29T23:10:18.604 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-29T23:10:18.604 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:10:18.633 INFO:tasks.ceph.mgr.x:Stopped 2023-09-29T23:10:18.634 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-09-29T23:10:18.634 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:10:18.666 INFO:tasks.ceph.mgr.y:Stopped 2023-09-29T23:10:18.666 DEBUG:tasks.ceph.mgr.z:waiting for process to exit 2023-09-29T23:10:18.666 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:10:18.742 INFO:tasks.ceph.mgr.z:Stopped 2023-09-29T23:10:18.742 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-29T23:10:18.742 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-29T23:10:18.742 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:10:18.761 INFO:tasks.ceph.mon.a:Stopped 2023-09-29T23:10:18.761 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-29T23:10:18.761 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:10:18.776 INFO:tasks.ceph.mon.c:Stopped 2023-09-29T23:10:18.776 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-29T23:10:18.777 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:10:18.793 INFO:tasks.ceph.mon.b:Stopped 2023-09-29T23:10:18.793 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-29T23:10:18.793 DEBUG:teuthology.orchestra.run.smithi115:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(RECENT_CRASH\)' | egrep -v 'replacing it with standby' | egrep -v 'No standby daemons available' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-09-29T23:10:18.812 INFO:teuthology.orchestra.run.smithi115.stdout:1696028692.8579416 mgr.y (mgr.4107) 1 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-29T23:10:18.813 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-09-29T23:10:18.813 DEBUG:teuthology.orchestra.run.smithi115:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(RECENT_CRASH\)' | egrep -v 'replacing it with standby' | egrep -v 'No standby daemons available' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-09-29T23:10:18.874 DEBUG:teuthology.orchestra.run.smithi115:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(RECENT_CRASH\)' | egrep -v 'replacing it with standby' | egrep -v 'No standby daemons available' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-09-29T23:10:18.885 INFO:teuthology.orchestra.run.smithi115.stdout:1696028692.8579416 mgr.y (mgr.4107) 1 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-29T23:10:18.886 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi115.front.sepia.ceph.com 2023-09-29T23:10:18.886 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-29T23:10:19.157 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-29T23:10:19.157 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-29T23:10:19.440 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-29T23:10:19.440 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-29T23:10:19.676 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi156.front.sepia.ceph.com 2023-09-29T23:10:19.677 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-29T23:10:19.871 INFO:tasks.ceph:Archiving mon data... 2023-09-29T23:10:19.872 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519/data/mon.a.tgz 2023-09-29T23:10:19.872 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2023-09-29T23:10:19.879 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.3nkFgYfoJQ 2023-09-29T23:10:19.879 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.3nkFgYfoJQ 2023-09-29T23:10:19.959 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.3nkFgYfoJQ 2023-09-29T23:10:19.981 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.3nkFgYfoJQ is 306KB 2023-09-29T23:10:20.040 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.3nkFgYfoJQ 2023-09-29T23:10:20.047 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519/data/mon.c.tgz 2023-09-29T23:10:20.047 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2023-09-29T23:10:20.053 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.d2qNzVdDuz 2023-09-29T23:10:20.054 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.d2qNzVdDuz 2023-09-29T23:10:20.158 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.d2qNzVdDuz 2023-09-29T23:10:20.221 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.d2qNzVdDuz is 430KB 2023-09-29T23:10:20.243 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.d2qNzVdDuz 2023-09-29T23:10:20.249 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519/data/mon.b.tgz 2023-09-29T23:10:20.249 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-09-29T23:10:20.256 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.8CGEssyQDq 2023-09-29T23:10:20.256 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8CGEssyQDq 2023-09-29T23:10:20.407 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.8CGEssyQDq 2023-09-29T23:10:20.433 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.8CGEssyQDq is 430KB 2023-09-29T23:10:20.495 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.8CGEssyQDq 2023-09-29T23:10:20.502 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-29T23:10:20.502 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-29T23:10:20.504 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-29T23:10:20.520 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-29T23:10:20.520 DEBUG:teuthology.orchestra.run.smithi115:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-29T23:10:20.522 DEBUG:teuthology.orchestra.run.smithi156:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-29T23:10:20.547 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-29T23:10:20.590 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-29T23:10:20.596 INFO:tasks.ceph:Archiving crash dumps... 2023-09-29T23:10:20.598 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519/remote/smithi115/crash 2023-09-29T23:10:20.599 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-29T23:10:20.615 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519/remote/smithi156/crash 2023-09-29T23:10:20.616 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-29T23:10:20.635 INFO:tasks.ceph:Shutting down logrotate 2023-09-29T23:10:20.635 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:10:20.638 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-29T23:10:20.683 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-29T23:10:20.698 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-29T23:10:20.735 INFO:tasks.ceph:Compressing logs... 2023-09-29T23:10:20.735 DEBUG:teuthology.orchestra.run.smithi115:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-29T23:10:20.744 DEBUG:teuthology.orchestra.run.smithi156:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-29T23:10:21.441 INFO:tasks.ceph:Archiving logs... 2023-09-29T23:10:21.441 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519/remote/smithi115/log 2023-09-29T23:10:21.442 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-29T23:10:21.647 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519/remote/smithi156/log 2023-09-29T23:10:21.648 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-29T23:10:21.753 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1895, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1472, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph_manager.py", line 3189, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2023-09-29T23:10:21.816 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=0adc665f788f41b19a4dcbc6ab3849d3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1895, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1472, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph_manager.py", line 3189, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2023-09-29T23:10:21.818 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-29T23:10:21.830 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-29T23:10:21.845 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-29T23:10:21.845 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-29T23:10:21.857 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-29T23:10:21.922 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-29T23:10:21.931 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-29T23:10:21.932 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-29T23:10:21.934 DEBUG:teuthology.orchestra.run.smithi156:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-29T23:10:21.954 INFO:teuthology.orchestra.run.smithi115.stdout: remote refid st t when poll reach delay offset jitter 2023-09-29T23:10:21.955 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================== 2023-09-29T23:10:21.955 INFO:teuthology.orchestra.run.smithi115.stdout: hv01.front.sepi 44.4.53.2 2 u 7 64 377 0.065 0.317 1.168 2023-09-29T23:10:21.955 INFO:teuthology.orchestra.run.smithi115.stdout: hv02.front.sepi 63.231.80.2 3 u 11 64 377 0.073 0.443 1.201 2023-09-29T23:10:21.955 INFO:teuthology.orchestra.run.smithi115.stdout:*hv03.front.sepi 74.6.168.72 3 u 10 64 377 0.079 -0.803 1.211 2023-09-29T23:10:21.956 INFO:teuthology.orchestra.run.smithi115.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-29T23:10:21.957 INFO:teuthology.orchestra.run.smithi156.stdout: remote refid st t when poll reach delay offset jitter 2023-09-29T23:10:21.958 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================== 2023-09-29T23:10:21.958 INFO:teuthology.orchestra.run.smithi156.stdout:*hv01.front.sepi 44.4.53.2 2 u 5 64 377 0.091 0.877 0.556 2023-09-29T23:10:21.958 INFO:teuthology.orchestra.run.smithi156.stdout:+hv02.front.sepi 63.231.80.2 3 u 6 64 377 0.081 1.127 0.573 2023-09-29T23:10:21.958 INFO:teuthology.orchestra.run.smithi156.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.112 -0.108 0.563 2023-09-29T23:10:21.959 INFO:teuthology.orchestra.run.smithi156.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-29T23:10:21.959 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-29T23:10:21.970 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-29T23:10:21.971 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-29T23:10:21.984 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-29T23:10:21.999 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-29T23:10:22.013 INFO:teuthology.task.internal:Duration was 823.196304 seconds 2023-09-29T23:10:22.013 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-29T23:10:22.027 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-29T23:10:22.027 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-29T23:10:22.029 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-29T23:10:22.080 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-29T23:10:22.080 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2023-09-29T23:10:22.081 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-29T23:10:22.092 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi156.front.sepia.ceph.com 2023-09-29T23:10:22.092 DEBUG:teuthology.orchestra.run.smithi156:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-29T23:10:22.108 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-29T23:10:22.108 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-29T23:10:22.110 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-29T23:10:22.138 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-29T23:10:22.139 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-29T23:10:22.141 DEBUG:teuthology.orchestra.run.smithi156:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-29T23:10:22.232 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-29T23:10:22.254 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-29T23:10:22.255 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-29T23:10:22.271 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-29T23:10:22.287 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-29T23:10:22.300 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-29T23:10:22.302 DEBUG:teuthology.orchestra.run.smithi156:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-29T23:10:22.316 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2023-09-29T23:10:22.316 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = core 2023-09-29T23:10:22.344 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-29T23:10:22.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-29T23:10:22.388 DEBUG:teuthology.orchestra.run.smithi156:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-29T23:10:22.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-29T23:10:22.394 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-29T23:10:22.407 INFO:teuthology.task.internal:Transferring archived files... 2023-09-29T23:10:22.408 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519/remote/smithi115 2023-09-29T23:10:22.408 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-29T23:10:22.432 DEBUG:teuthology.misc:Transferring archived files from smithi156:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519/remote/smithi156 2023-09-29T23:10:22.433 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-29T23:10:22.456 INFO:teuthology.task.internal:Removing archive directory... 2023-09-29T23:10:22.456 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-29T23:10:22.458 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-29T23:10:22.463 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-29T23:10:22.477 INFO:teuthology.task.internal:Not uploading archives. 2023-09-29T23:10:22.477 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-29T23:10:22.488 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-29T23:10:22.489 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-29T23:10:22.508 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-29T23:10:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 29 23:10 /home/ubuntu/cephtest 2023-09-29T23:10:22.517 INFO:teuthology.orchestra.run.smithi156.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 29 23:10 /home/ubuntu/cephtest 2023-09-29T23:10:22.518 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-29T23:10:22.529 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-29T23:10:22.553 INFO:teuthology.nuke:Checking targets against current locks 2023-09-29T23:10:22.580 DEBUG:teuthology.nuke:shortname: smithi115 2023-09-29T23:10:22.580 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-29T23:10:22.605 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 22:47:28.262461', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-09-29T23:10:22.640 DEBUG:teuthology.nuke:shortname: smithi156 2023-09-29T23:10:22.640 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-29T23:10:22.668 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406519', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 22:47:28.261044', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-09-29T23:10:22.693 INFO:teuthology.orchestra.console.smithi115:Power off 2023-09-29T23:10:22.694 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T23:10:22.718 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-09-29T23:10:22.718 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:10:22.732 INFO:teuthology.orchestra.console.smithi156:Power off 2023-09-29T23:10:22.733 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T23:10:22.742 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-09-29T23:10:22.757 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-09-29T23:10:22.757 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:10:22.780 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-29T23:10:26.743 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:10:26.781 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:10:26.854 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-09-29T23:10:26.891 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-29T23:10:30.859 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:10:30.892 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:10:30.969 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-09-29T23:10:31.001 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-29T23:10:34.970 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:10:35.002 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:10:35.080 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-09-29T23:10:35.113 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-29T23:10:35.181 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-09-29T23:10:35.214 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-09-29T23:10:35.320 INFO:teuthology.run:Summary data: description: rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{ubuntu_latest} tasks/crash} duration: 823.1963036060333 failure_reason: '"1696028692.8579416 mgr.y (mgr.4107) 1 : cluster [ERR] Unhandled exception from module ''pg_autoscaler'' while running on mgr.y: ''PgAutoscaler'' object has no attribute ''noautoscale''" in cluster log' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=0adc665f788f41b19a4dcbc6ab3849d3 status: fail success: false 2023-09-29T23:10:35.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:10:35.402 INFO:teuthology.run:FAIL